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ABSTRACT 

The purpose of this study was tc review existing 
human operator modeling technigues . and evaluate their potential 
utility for performance measurement applications (€,g. , tc support 
the type of flight simulation research that entails acccutting for 
the perception and utilization of various cues) • The major human 
operator characteristics that ought to te accounted for ty a useful 
model were identified: psychological refractcry period, operator 
intermittency, range effect, inadvertent cr cssccupling , tang-bang 
control, and cue utilization. Exi^sting ncdels %iere then categorized, 
surveyed, and summarized. The categories cf models surveyed include 
describing functions, optimal control model, discrete and finite 
state methods, adaptive technigues, preview models, and other 
nonlinear approaches. Models in each category were evaluated based on 
the extent to which th^y represented the identified human operator 
characteristics as ^11 as other aspects cf their general validity 
for performance measurement applications. Results were that none of 
the models implemented more than a few of the human operator 
characteristics; many were based on assumptions that were 
unacceptable for measurement applica ticns ; and ethers had not been 
developed far enough to justify their use as a point cf departure for 
measurement. It was concluded that existing models uere not 
sufficiently representative of known characteristics of human 
behavior to be useful for general application in performance 
measurement. (A 100-item bibliography is included.) (Authcr/JH) 
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iMsiniL- j>citoiiiiiiiiL\' mc.isuiciiicii! Icchnuiucs do iiui li;ivv the c.ipLihilily lo suppoil llic l\ pc nt 
tlt^'.fu snmtljtioii icsc.ncli iluii cnljiK imp toi (he pciccpluMi iind utili/alion ol various cues. In 

:klilMiuii\ ^nc iniiMv I'll^ils in^lciivc more Miilal>lc incasuics have rurthci com plica led' llie prDhlcm by 
.!ovclo"pmjJ HHuc and iii'oie mcasmes tioni which to choose hiH wiilMillle rci^ard tor ihe cllecis ul an 
i!Oinop..r chnia- I iic\ li.ive als»> been inisdircclcd in ihcii emphasis on system pertornuuiee rather than on 
*i;iiin!i helijuoi ^\ |U'\^ me.t^mcmeii 1 appioach is iciiuired whicli nmumi/es llic mimlvr ol measures thai 
musi h.e s.onsuleied. compiiied. aiul inlerpieieil ; and which ptodiices measures thai chaiacleri/c hehavior 
suceinciK and aic sciisilisc 'o ihosc aspects human l^eliavior thai directly involve coc perception and 

iitih/ation * ' - . • 

■ \ 

Approach 

Ollcii. Ihe jnosi concise wa> lo repieseni a set ol data is to model the process that generated it. If 
modehne lechmii'ies weic apphcil to human peilormaiice ineasuienient Jt is coneoival)!e tliat an optimally 
concise set ol measii res\ouUI he pioduccd tn^m the model ilsell. Jl the model were earelully tormulated 
and \jhdaled. nieasuies denied tn>m il would characteri/e human liehavior rather jlian the ettect oriiuil 
behavioi on ^vsieni i espi>nse : and ihc> could he UKide to include the impact or^varioiis cues ami .ilu' way 
llie> aie peiceived. iPleipiclcd, and applied. Hie purpose ol' this study was todctefnhne which, if any . ot 
i}ie existmi' human opeiatoi iiiodels mnjit i^e usetul m tins regard tor perroriu;uice ni e;isni ement 
ipf^lkMii.mN Since in^nlel \alidit> is particularly impo:tant in the case of lire envisioned lueasuremeni 
appli' afuMis the Insi lask ol ihe study was to identify llic major human operator characteristics that ouiiht 
lo he a.cinnued loi. Ihen exist mi.' models weie categon/cd into six types. A survey was made of models in 
iMcli caic'.'of\ b> leviewinu the hieialuie and sunnnari/iiii! the various imxleling studies. ModOls in each 
-catc*.!orA weie calualeil hased <m ihe extent to which they r^'preseiU the identitied human operator 
criaKicieri-aics as wi-|| as oi hct ^ispeuts of their general validity for perforuuince measurement. applications. 

Results 

Sevcial h,\mian OjU'ialoi characteristics were ideiitilicd which oudit to he included in or otherwise 
.accounted torA niod-ls lo he used lor measurement applications. The categories of models surveyed 
include descn/jjii liinciious. opimial coiiirol nuHlel. discrete and finite slate methods, adapt ive techniques. 
pieMev\ module and oihei lumlnieai appioaches. kesnlis ol" the e\aluatit)n nrc ihat none of the nuHlels 
revie\veLl implement moie than a lew of the identified ImiiKin operator characteristics.' those which have 
atU'inpied to mcorpoiate known oi iheori/ed infoiination about the human are either hased on associated 
nssnmpMons ulii.;h ate unacceptahle foi measurement applications or have not heen developed tar enough 
lo iijstilv HiLir Use .is a point ol' ileparl uie loi nieasmeinent . 

(■(Uichisions • 

Ixisim'.' human o.vf.iloi models are nv)l sutlieientl> lepresentalive ol known characteiistics o\ 
luim;m heh.iMoi lo l^c usetul toi ivneial performance measurement applications. It ap|n\irs. too. that 
modolni^L' sindies ot ihe (>asi have emphasi/ed matclnng the response of the aveiage operatoi at the expense 
ol nndelini' the bchaMoi of ihe individual, lor the particular application area of peilormance 
me.tsureuKMi L this is unacceptahle. Studies aie lequired to develop imnlelinu tecliniiiues specillcally loi 
meas'iicnu'ii! usc^. aTul ihcse siiidies should he hased on valid assumptions ahout the human that aie 
siii>^<7TeTT^fs. (he fmd;, lehueil kniuvlcili-e lhat piesentU exists. I itirrllv' it should l)e noted that the tact 
/moiijis aie eonsideied imsuitahle toi measineinent applications should not i^e iiiieipretetl as 
ie> aie neccs^all!\ vieued as had nuKlels in general. When used foi the puiposes tor uhich 
and vwlln.n the eonlines i)f the lelated iimlerK mg assuni|Mi()ns. some exist inj.' models 
frave l)e'/n applieil successt nil > toi ui;ui> ditricult tasks involviinj the ptedietion oi 
4UU1I V SIS ol killed oei I > m maiice. 
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siM<vi:V 01' iiUMANOPKiuTOR MODi:L)N(;:n:ciiNioui:s 

I'OR MIlASURliMI-NT AlTLICATIONS 



I. IM RODHCriON 

This repoii ilescribcs the result.; of j survey 
effort to assess tiic upplieability ul luiniat) 
operator niodelinj;^ lechniijues to pcrfuniiaiice 
ineasuremeiit. Specitie objectives were to deter- 
mine the state-of-the-art of human operator 
modeling; Identify liuniaji operator cliaracteristics 
tliat should be considered in models to be used for 
measuring perforniance: assess the existing models 
on the basis of their inclusion uf known or 
thoori/cd human performance characteristics; and 
develop a general prognosis of satisfying lequire- 
mentsf- for sensitive performance -measurement 
usiiig existing huiiian operator - models as a 
foundation. 

Background and Problem 

The lack of sensitive and ijffijectjve nieasur(?s of 
human performance for many complex continuous 
tracking tasks has been a persistent problem for 
many years. This probleili has been particularly 
iniportant and norieeabie in the area of flight 
simulation research, where methods are required 
for devefoping and evaluating techniques of 
generating and sustaining the cues required for 
effective training- This includes distinguishing 
between the cues th^t are essential to training and 
those that are just expensive cosmetics; and, deter- 
mining the effects performance, training, and 
skill retention of providing the required cues in 
various ways. Obviously, for this type of research, 
measures are needed whicli are objective, valid, 
reliable, and most important . sensitive to changes 
in the way cues are perceived and used in the 
development and learning of perceptual/motor 
skills. 

Existing measures do not have the necessary 
characteristics to support the type of fliglit simula- 
tion research that entails accounting for the 
perception and utilization of cues, hi various 
attempts to develop suitable technology over the 
past two dceadcs* there has been a prolifecation of 
different measures from which to ciioose, but little 



headway in achieving the breakthrough that the 
problem demands. In a way. much of this activity 
has probably crei;tcd a false sense of security. As a 
result, not cnougji research has been cimducted on 
measures spceifivally oriented toward reseureh 
applications. 

.Associated witli the generation of ton many 
measures has been a general laek of appreciation of 
the deleterious effects of choosing the wrong 
measures for a given research application. 
Obermayer. Swart/., and Muckler. (1962) providi^s 
an excellent illustration of this by demonstrating 
the effect on sti'ay results of selecting various 
performance measures. The subject studied was 
the interaction effects of displays with system 
dynamics and course frequency in continuous 
tracking tasks. Both pursuit and compensatory 
displays were used with three levels of course 
frequency and position, rate, and acceleration 
control dynamics. Seven measures were computed, 
among which were average error (AH), average 
absolute error (AAR). root mean square error 
(RMS), and time on target (TOT). Results show 
that if Al£ had been selected as a single measure, 
the conclusion would have had to be that none of 
the experimental variables had a significant effect 
on perfortnance. In contrast. AAB. RMS. and TOT 
all indicated significant effects for course fre- 
quency and dynamics. Further, the three-way 
interaction effect of displays, frequencies, and 
dynamics wiis significant (.01) using AAt* and 
RMS but nonsignificant (.05) using both AF and 
TOT. One can only speculate about the number of 
past and contemporary studies which would yield 
similar di.scordant findings if subjected to analysis. 
As the authors surmise . 

Obviously, ihc iiiicrprLMjiions ot ilicsc (lata 
arc oritiL'aMy dcpL'ndcni upon ihc pariie'Uljr 
measure, and ih-j analysis has boon 
presented wiih this lact^,in mind. However, 
line miiiht speculate on past disphiy siudies 
where a sirii!le measure was seleeied and 
wonder if . ratiieally dillerent results and 
conclusions iniglK noi be,,drawn il anoiher 
Lt>nvejitional measure lUui l>ecn selected, n 
has been apparent to many tor soino lime 



that the qieihoch)lo^y of human coniinuoas 
performance nicasuremenl is in serious 
difficulty* and bothi Ihcot^eiical and 
• mcthodoloiiical studies in performance 
measurement arc ur^icntly needed, 
(Obermaycr.ct al.. l'962.p. 212) 

Myers p/escr\is another enlightening exanSple of 
the differing results that alterriative measures. cap 
produce (Myers. 1972). In this easy, the example 
hinges upon the facU that while twb measures niay^ - 
be equally valid for assessing some skill, they may 
not be equally suitable for actual application 
within the constraints of a given experimpntal 
design. Both response time and its reciprocal, 
response speed, were used in an analysis of 
variance. In the case o{ response lime, tlie 
computed F-ratio was 2.87, which, was ^not^ 
significant at .05.Tlie F-ratio using response speed 
was 13.56. which Vas significant at .01. These ^ 
diverse results were a consequence of the fact that/" ^ 
the response time measure revealed interactioriV-' 
effects more clearly and reduced the po\Ver of the 
F-tesl. Tlius, the appropriateness of conimonly 
used measures must be evaluated in light of the 
experimental design to be applied as well as the 
skills to be assessed. 

There is some evidence that mariy of our efforts 
to derive suitable measures have been misdirected 
in that the wrong type of measure has. been 
souglit. A distinction . may be made between 
m<;asures of system performance, througli which it 
is hopejJ that something may be inferred about 
human performance, and ipe^isures of human 
behavior, of which human perfoniiance is .a 
..derivative. System perfomiance measures are 
confounded by variances whose^ sources are not 
confined to the human operator. As a result these 
measures, which are commonly applied in fliglit 
and simulation training and .research, are often 
unreliable indicators of human pcrfojmance. !n 
what has become a classic illustration. Taylor and 
Birmingliam (^959) showed how several instances 
of the s'ame human operator behavior can be 
misinterpreted as different behaviors by using 
system peKormance measures. This was done by' 
using a single servomechansim model to generate 
outputs to various control dynamics and demon 
^strating the differences in system measures th: 
resulted. Not only can these measures effc. 
behavior misrepresentation througli the incorrect 



assertion that it is .different when '. is not? but 
system measures, v/liich are generally of the 
integrated or average **summary" vaiHety, can 
mask important changes in behavior. This was 
nicely demonstrated in a study of the differences 
in performance when controlling or monitoring 
several systems rather than , just ,one (Jackson, 
1958). It was shown that niein error as a measure 
merely -indicated that errors increased as the 
nunfiber of systems , (dials) increased. However, 
more elementary nieasures* Of- behavior showed 
that the operator drd a lot' to try to prevent an 
increase in errors. He made quicker control 
movements, mad^p quicker ' switches froni^,'one 
control to another, and anUcipated coming events. 
It v/as concluded ' that' overall measures of 
performance conceal rather than expose the details 
of behavior. 

- "If seems, then, that there is a two-part problem.* 
First, existing measures are not adequate for 

simulation research ap^plications. Second, the 
many efforts to derive ^more suitable measures 
have (a) further complicated the problem by 
developing more and more measures from which 
to choose 'with little regard for the effects of an 
improper choice and (b) probably been mis- 
directed in their emphasis on measures of system 
performance rather than measures of human 
behavior. Based on these observations, a solution 
lo the problem must be built around a new 
approach that, first of all, does not merely add to 
the already overpopubted group of system 
performance measures. Instead, it mast minimi/e 
the set of measures that need to be considered, 
computed, and interpreted. Secondly, the 
approach must prc3duce measures that characterize 
behavior succinctly and are sensitive to changes in 
those aspects of behavior that, directly involve cue 
perception and utilization. 

Often, the most concise way to represent a set 
of data is to model the process that generated it. If 
modeling techniques were applied ^ to human 
performance tnKisurehicnt . it is conceivable that 
an optimally concise set of measures could be 
produced from the model itself. If the model was 
carefully rormuhlted iind validated, measures 
derived from it would diaracten/e huijUm 
behavior rather than the effect of that behavior on 



sysYtiu resiHn>so. aiul tlicy could he iiiailc to' 
incluiJe llic unpait ut various cues ami flic way 
llicy arc perceived, inlerprclcd; and iipplicil. The 
polcritial ot ilyniiiiiL. iiiatlieiii;ilical inoilels for 

. lliis ap.pliciilioii is nicely staled by McRucr and 

•Kreiulel (1^)74): 

SkrII. lui "I'x.inipk'. Is J ninii'pr Mliich hav 
hci-n lU'srrihiHl in Mkli iniuilui- U'rnis 

"siMpK'IKA' ^ilMi'IlK limal Tisponscs" .iiui 

■ ■"thi- oul si .m-liiii' ilhiMvIci t>t r.ipul .uljpi.i- 
imn " 1 he .1 V .1 1 1 .ih it 1 1 \ ol ilvn.iuiK- 
il osi r I pliitiis III liuiiijn »onlrol .u lioiis 
I'li.iMi' Us In ^qii.inl ity ■'Ui-iilC imuxr" in „ 
• tjshion iu)i oHiLTwisL' possilijc, Siniikirlv. 
riK' tiiini.in jhiliK^in jd.ipi cm lu- miiui'il 
inrr.Hlil> lUi.inliri.ihlc i Ikmilil's tn Ihc nijilu'- 
in.iiic.il hum mT ilu' Ui'smpiion ui rlu- 
i»">ntr.i| .Kiinns. I NUUniT »Sc Kn-ntli'l. I'-na. 
p. 1 /I 

AniMlicr imlicaiioii ot (lie poiculial of" niodcliiii: 
lecliiiiiiucs lor measure men I is piovuleil by l*cw 
and Kupp (1^)71). Thev lii a deserihiiii: tuiielion 
model In Mio ciMiipensai < m \ tracking chiia of tiic 
4l[i, 7»|,_ and lOili graders on each ot" several 
sikvc^sivc I rials ami examined ihe eliange in 
coc tt ieieiu v.ilues aeross i rials. The iwo 
coetrieieiils, K and lAVx rei)reseni I he gain .or 
rcsptmsc anipliUule aiul lime ilelay. respeeiively . 
Ut-'sidcs demonstraiing a Icariiini: elTcci. ihesc 
'-•oetlieicnts proviilcil a liircet explanaiioti of how 
and wliy learimii; occiirieil loi each grade eroup. 
llie example is impiL'ssive- because dI" ihe great 
deal ol iiisidu inio behavior iliat iho use ol such a 
simple model can piovalc. As the auiliors so aptl> 
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t)peraior models iniglii be useful per ton nance 
measurement apfMieations. Tliis involved' a review 
of work dating from as early as P)44 on advancing 
tlie state-of-the-art of human operator, modeling 
{Young &. Stark, 196.S). 'Hie large number of 
availabl-c references made organi/atit)n of notes 
and matv. als dif''u;uli. The approach that seemed 
to. woik the best, anc' liic c?n.> which has been 
applieil ill organizing this ret^ort, w;isto gioup the 
material acct)rding to type of model as loUows': 

L Describing Functions 

2. Optimal Coriirol Model 

.V Discrete and Finite State Methods 

4. Adaptive Techmqucs 

5. j Pre view Models 

0. Other Nonlinear Approaches 

The abnve categories arc not mutually 
exelusive. e.g.. it is possible to nuKlify a iiKxlcl 
that is basically a describing function to outllt it 
with adaptive eapabiUtics. Tlie classitlcatir>n rule- 
of iliunih that was applied was to assign a model 

that category which best distinguished it tVom 
a N predecessors. 

The literature survey begaii with a review of all 
proceedings of the Annual Conterences on Manual 
Control and branched from there to the references 
citeii therein. A Defense Documentation Center 
(DDC) bibliographic search and several very good 
survey reports (most notably Costello & lliggins. 
M)(i(): Kelley. l^)6Ha; Summers & Ziedman. 1%4: 
Viviing & Stark. U)65) ipiickly provided an 
inuiulation of sources. The remaining ' retcrences 
were located througli scanning the indexes of 
jonrnals (e.g.. Jounial of Fxpcrimental Psycho- 
logy, Human Factors. Psychological Bulletin, IITT- 
Transactions. Automatica, and Journal of Motor 
Behavior) and through helpful tips and the loan of 
.v el 1 -in ar kcil copies of tavorite [Xipcrs from 
interested colleagues. In preparing this report, 
those lU^cuments judged to be the best sources of 
uitorniation were used ;*.s references, with alter- 
native sources ami those containing supplementary 
i'ltormation :elei.-.;{ed to llie Bibliograplu . 

Ihe results of this act ivity have included 
accomplishment of the original objective to assess 
the potential o\' existing mixlels for perform:«ice 
ineasureineni applications. In addition, a sub- 
stantial library ami a heightened apiueciation for 
the bod \ o f knowledge in manual cont rot 
modelitig have been accjuired. P'inally. a plan has 



been torniulatcd to guide research elTi)rts in the 
dcvclopinent and application of »iu)deling concepts 
tor use in }Krl"orinanee inc;isur'"nent . 

II. HUM-VVOiM KATOK 
CHAKACnRISTKS 

Wlicn a model is. to be used to analy/e and 
assess its object, it is especially important that it 
be valid, hi particular, predictive validity is 
required, since the intent is to lit the model to a 
specific set of data but- use it to predict or ir. I'er 
general behavioral attributes. To insure predictive 
validity, it is not enougli to merely demonstrates 
close match between mtitlcl and human out put lor 
a lew selected test cases, and it is impractical to 
extend the testing over all eonccivable conditions, 
histead. the best approach is to bUild contcm 
validity into t^ic niodel. This means that the 
eonstrueU of the model and Jjjie ajssumptions on/^ 
which it is bifsed must be in full accord with the 
body of knowledge that exists regarding the object 
being modeled. 

In tli'c case of human operator modeling, the 
intended application in the area "of performance 
incasareuient requiits that the model does not 
violate accepted bohaviqral principles by virtue of 
its constructs or assumptions, hi addition, it 
siiould incorporate 'these principles wherever 
possible. In this way. stratified testing is only 
necessary to provide . empirical evidence of the 
validity that was already embedded in the model 
at its inception. 

Over the years, a great deal of knowledge has 
been accumulated, larg'dy . through psychological 
research, about human operator eliaracterlstics. 
So'^iie of these characteristics are well supported 
by empirical evidence and are generally accepted 
as factual; others are more controversial, offering 
4iossible but not exclusive explanations -for 
observed behavior. Whichever the case, they 
should be considered, if not included, in human 
^operator modeling efforts where content validity is 
important. Following is a discussion of the major 
human operator characteristics that merit 
consideration. 

Operator Intermittency 

Theories and studies about operator inter- 
mittency have a long history in psycfiology, dating 



a't least as l -jr'back as \'U ^ (Kelley, PK^Xa). One 
reason the toj^ic coiUinucs to generate debates 
today is not because of a disagreement ahout the 
existence tif iiitermittLMicies in responsi? data, but 
' • oau.se there is a disagreement aboiU their cause. 

addition, the source of intermittencies is still 
unknown. Hiey may originate in the inpiu 
receptor systems, in central processing, or in the 
muior. output systems, finally, there has been no 
consistent Ni,le fin It ion of operator intermittency. 
T^ was recogni/.ed by Summers and Zied^naji 
\\ proposed a liberal dellniiion of an inter- 
mittent process as . .one in which information is 
received, .processed, and transmitted at discrete 
i ntervals or instants of time'' (Summers & 
Zlednian. '1964. p. 6). Between these intervals, 
new information cannot be used by the system, 
and processing must rely on previous samples. This 
definition does not involve notions about 
periodicity in responses as assumed by iiiajiy of 
the earlier investigators (e.g.. Craik. 1947) 

The original intermittency hypothesis was 
developed by Craik in 1945 and was prepared 
posthumously for publication by his student. 
Margaret Vinee, in 1947. Bertelson (1966) 
'provides a concise anU insightful review of the 
early work in this area, and much of the immedi- 
ately foiiowing information is taken from .his 
paper. Craik's thesis was tliat man behaves as an 
intermittent correction servo. Evidence for this 
intemiittency wa^ the jerky characteristics of 
tracking records. Craik's studies, as well as those of 
Vinee (1948a), suggested that there is a period of 
about 0.5 second" following a stimulus during 
which (a) some response is ^elected and executed 
and (b) no respc/nse to a second stintulus can 
occur. To this period, Craik followed the lead of 
an earlier investigator (Telford. 1931) and 
attached the name "refractory phase." which was 
long bcfoiC known to exist at the levels of simple 
physiological systems.' 



'Bertelson points out lliut the analogy between the 
refractory periods ol' Craik anthihe physiologists is u loose 
^ one. and iliat Cruik's accept unee ot the term is- un- 
to rtunatc<fytSrinp the pliy.siolopieul refruettuy phase, the 
tissue does not respond to [\ new stinuilus; however, 
(turinii the psychologicul rctraetory period . u respon?;c lo a 
new stimulus of equal intensity cun btiiclicitcd. but with a 
greater luiency. . ' 



|-nlIowiii^ Craik's ilciitli. liicrc were (wo 
important ilcvclopnienls. One was tlie eDMipIclion 
and public:* I ion « experiments by Vinee (1948b) 
winclj involved ti.icking o\ ii tiirget wluch chiingcu 
position lit discrete intervals. Tins permitted direct 
ineasurenicnt ol movement and reaction times and 
proved that when two step inputs occur at 
intervals shorter than 0.5 second, the reaction to 
the second step has greater latency. 

The other development was tliiit of the single 
channel hypothesis, promoted concurrently by 
Hick (1048) and VVcHord (1952) but most clearly 
formalized by the latter. This hypothesis was a 
direct outgrowth of the work ofCraik and Vince. 
I! proposed that' the delay in, responding to a 
second stimulus is due to the inability of central 
processes to deal with two stimuli simultaneously. 
Instead, a second stimulus must be stored^ until 
processing associated with the first stimulus has 
been completed. According to Bert els on, the 
importance of this work was mainly in the 
adoption of reaction time to a second stimulus as 
an estimate of the time during which processing of 
the first stimulus was still taking place. Later, 
when inlcrslimulus intervals greater than a single 
reaction time were also found to produce greater 
response latencies, revisions of the hypothesis were 
suggested. For example, one suggested by- Mick 
was that refractoriness (i.e.. the occupation of 
central processing mechanisms) may also be caused 
by the subject's attention to his owg response 
(Hick. 1948). 

Bertelson observes that a major impact of inter- 
mit tency research has been to suggest a way of 
analyzing complex activities by breaking them into 
basic decision units, during each of which a choice 
is. made of a reaction for a particular sample of 
sensory inputs. The size of these decision units is a 
fundamental parameter of any intermittency 
model but, except for Craik, few investigators have 
addressed this issue.- Investigation of unit sizes and 
the associated grouping of -stimuli has been, in 
Bertelson's opinion, "the most serious missing link 
in the study of intermittency'' (Bertelson, J966, p. 
157). 

The jerkiness in tracking records observed by 
Craik was exhibited largely by novice performers. 
More experienced perfonners often demonstrate 
long periods of smooth response in continuou$ 



tracking (Adams, 1^)01), This has not served as 
groumis lor seriously challenging the intermittency 
hypothesis, although Adams believes tliat it 
should. Instead, tlie smooth responses arc 
explained by Craik ( 1947) and others as emanating 
from an acipiired ability by subjects to predict 
input sequences and overlay a sm(K)tiVing effect on 
what is otherwise a series of intermittent move- 
tnenis. This contention, which w;is an atl hoc 
analysis on the part of Craik, was .supported by the 
work of Navas (1%3), whi) found evidence of 
intertnittency using unpredictable inputs but not 
using predictable inputs. 

There are several, independent studies^ [Providing 
evidence lor intermittency. Some of these are 
nicely summarized by Sheridan and Ferrell (1974). 
In studies of chxsed loop manual control, Bekey 
(1962) found a concentration of response power 
between 1.0 and 1.5 Hz. leading him to the 
conclusion that human response consists of a series 
of ballistic movements. Step inputs were used in 
another study to illustrate that responses consist 
of several discrete steps of. first, a ballistic 
response and. second, a series of discrete 
adjustments (Taylor & Birmingham, 1948), The 
work of Navas (1963). not only provided inde- 
pendent evidence of inter mitte n c y f o r 
unpredictable inputs, but also produced evidence 
that the intermittency is due to a sampling effect 
rather liian to a quantization of the input. Finally, 
there is some evidence of abrupt changes in the 
velocity of control motion duririi; continuous 
tracking. This has been interpreted as an indication 
of sudden, discrete changes in muscle force level 
(Kelley, 1968a). Other justifications for accepting 
the intermittency hypothesis are provided by 
Kelley (1968b). ' • 

There have been four main hypotheses for 
explaining. why intermittency in responses occurs. 
Tlie most popular is the existence of a 'psycho- 
logical refractory period, as originally suggested by 
Craik. (This is sometimes augmented by further 
assumption of the single channel hypothesis.) 
Second is the expectancy theory which, according 
to Bertelson (1966), has been formulated several 
tinies (in 1950, 1955, & 1962). This theory is 
based on -the- well known Ja<J{ that ihc reaction 
time to a signal varies with the proBability of the" 
occurrence of the signal as observed by the 



subject. If two signals arc to be given in succession, 
the subjective probability of the second one 
occurring. ^\wcu that it has not yet occurred, is 
lowest immediately after the first signal and 
increases thereafter. This is used to explain why 
second signals result in a longer response latency 
when they closely follow first signals. A third 
hypothesis for explaining ititermittency is that 
inputs are quantized arid that a subsequent 
response is not initiated until the input moves to a 
new quantum IcveL This theoiy was disputed by 
Navas (1963) but has been supported through the 
success of soniL models fashioned on its behalf 
(e.g.. Costello, 1968). Finally, a fourth hypothesis 
is that once initiated, response movements are 
open-loop for a time, neither depending upon nor 
using continuously available fcedbaek information 
(Adams, 1961; Taylor &. Birmingliam, 1948). - 
Therefore, the human executes response sequences 
Mliat are momentarily independent of the input 
and, tiuis, intemiittent with respect to it. 

Psychological Refractory Period 

As indicated in the foregoing subsection, the 
existence of a psychological refractory period 
(PRP) was proposed by Craik (1947^ .as one 
possible explanation ^ibr intermittency. Tlil5 PRP is 
found when two stimuli are closely spaced in time. 
Response tune to the second stimulus is longer 
than the response time associated with n single 
stimulus. l\xe only important exception to this is 
that when two signals occur almost simultaneously 
(within .05 sec of each other), they may be 
handled together (W .'lford. 1960). Both signals are 
apparently responded to as a single unit in this 
case. However, once the human is commilted to 
handling one stimulus and its response, he|Caiinot 
handle another until he has completed tiie first 
(ntts^LPo.sner, 1969). 

Almost as soon as it was suggested as an 
explanation for intermittency, the PRP was 
subject to question. Vince < 1950) concluded that 
the PRP is not absolute and observed that many 
times when two stimuli are given in succession, the 
first response is suppressed or modified by the 
second. Since then, three distinct theories have 
been proposed and studied to account for the PRP 
effect. (Smith. M.C. 1967). 'fhc single channel 
thcor\' is based on the assumption of a limited 
capacity channel and the related inability of man 



to process two stiniuli simultaneously yFH«..C£ntral 
refractoriness theory proposes that/ there isNa 
physiological inhibitory effect of/one stimulus^ 
upon a succeeding stimuljc. Finally, th^ 
preparatory state theory suggests that a delay/fn 
responding to a second stimulus is primarily dfic to 
the subject's expectancy of andMr readi^ss for 
that stimulus, not to physiologicaNshirfLicteristics 
or limits in processing capacity . 

liach of these theories has its supporters and 
offers a unique explanation, for certain data. For 
example, Poulton (1950) tound that regardless of 
how long a subject is allowed to recover from a 
previous response, if he is not expecting to have to 
make a further response, he will have a delayed 
reaction time to a second stimulusr This is most 
easily explained by lack of preparedness on the 
part of the subject. According to Poulton, 'Mf, by 
dividing his attention, the subject was able to 
prepare for his next response while making his 
previous one, the so-called psychological refrac- 
toriness eould be completely absent" (Poulton, 
1950, p. 99). In contrast, convincing evidence 
against the preparedness theory was provided by 
Davis (1965), who sliowcd that reaction time 
delays can be ehniinated when the first response is 
spontaneous rather than elicited. Finally. Creamer 
(1963) demonstrated that event uncertainty rather 
than temporal uncertainty could produce reaction 
time delays to the second stimulus. This 
represented a vote against the preparedness theory, 
and Creamer interpreted it as evidence for the 
single channel theory. 

Despite continuing debates on the subject, the 
single channel theory seems to best account for 
the bulk of data and is least' subject to. critique 
(Smith. M.C., 1967). There is no physiological 
evidence of refractoriness in the nervous system 
for durations as long as have been observed; there- 
fore, the central refractoriness theory has little 
support. Readiness is hel'ieved to play 'some role, 
but Smith points out that it is not an adequate 
explanation by itself. This is largely because there 
is still a reaction time delay when all uncertainty 
about the arrival time of the second stinuilus is 
removed. At least some of the disagreement may 
he attributable to different experimenters giving 
different interpretations to tracking records 
(Voult on. 19 74). (For examine, when two 
responses follow each other closely, it is not 



always possible to distinguish between a prcpro- 
griniinied double response and two separate 
responses.) In any event, it appears that we can 
only conclude that some type of "refractoriness" 
exists and that the most defendable explanation 
tot it. so far. is the single cluinncl theory. 

Range Effect 

An often demonstrated ;uid commonly 
accepted aspect of human |x;rformance is the 
range effect. Tliis characteristic was discovered 
and named by Searle and Taylor (1948). who 
observed tiiat step inputs of random magnitudes 
elicited responses whose amplitudes tended to the 
mean. The range effect is sometimes called the 
central tendency of judgment (Poulton. 1974). 
since it represents the human operator's tendency 
to respond lis if the stimulus were of average 
intensity . ' After he has tracked for a\vhile, the 
human prepares tor an average input. If the actual 
input is smaller than expected, he overshoots; and 
if it is larger than exj^cted. he undershoots. Tlie 
range effect is a function of relative rather than 
absolute values of signals (Ivllson & Wheeler. 1949) 
and is. therefore, not observed until after the first 
several trials have nvade available information 
abt)Ut the values to be expected. 

The range effect is asymmetrical in that the 
rcspt)nscs to small stimuli are more heavily skewed 
to the mean oi' the scries of stimuli than are 
responses to large ones (McRiier & Krendel. 1958). 
In addititni to applying to stimulus amplitudes, the 
range effect also applies to the times and 
directions of stimuli (Poulton. 1974), For 
example, after the human learns the average time 
interval between two steps, he will tend to respond 
early when the interval is long and late when it is 
short. Since this is true, it is possible that the range 
effect may accentuate characteristics i^f the PRP 
aiuL except at long interstlmuhis mtervals. may 
not be distinguishable from it. 

l"rost (1972) observes that the range effect 
.shows that the hiinuui operator responds to the 
total situation, not to instantaneous iiifuits. It is 
produced by conditions that let a response be 
ba.sed to some extent on a comparison of the 
present input or stmmlus with previous ones. 
Perhaps more than an> t)ther human performance 
characteristic, the range effect in tracking is 



accepted as factual due to the frequency and 
consistency with which it is observed. 

Inadvertent Crosscoupling 

Crosscoupling can refer to a characteristic of 
the control system or to a characteristic of the 
luiman's control technique. When used in the" 
tormer context, crosscoupling indicates that a 
movement of the control stick along one axis 
results in an effect on the system in another axis. 
For exami>le. moving an aircraft control stick left 
or riglit results in a loss of altitude. In the latter 
context, crosscoupling indicates that the control 
Itself was moved along several axes sinuiltaneously. 

Bekey. Meissinge.r, and Rose (1965) identified 
inadvertent crosscoupling as a human operator 
characteristic tJiat must be accommodated in 
modeling performance on two-axis tracking tasks. 
This refers to an .unnecessary movement of the 
control in one axis when activity should have been 
limited to control movement in anothe? axis. 
Bekey identified two potential sources of this 
behavior. One is perceptual crosscoupling. or the 
inability of the human operator to distinguish 
motion in one itxis froiv. motion in another. The 
other is motor crosscoupling, or the inabihly of 
the operator .to |vrforin in one axis without 
inadvertent movement in tJie other. Based on 
modeling feasibility studies. Bekey showed that 
additional terms to account for this inadvertent 
crosscoupling are necessary when using describing 
function types of models for the separate axes in a 
two-axis tracking task. 

Bang-Hang Control 

It has been repeatedly demonstrated that when ' 
the forcing function increases in freqviency. the 
human i^perattu's control technique changes in a 
relatively predictable way (Summers & Ziedman. 
1 964), First, a continuous appearing, smcwth 
control action changes to one of making discrete 
corrections about every .5 second as forcing 
fvinction frequency rises. Tlie operator attempts to 
center control at the peaks o( the waveform rather 
than attempting to snux)thly track the entire 
function. If the frequency is further increased, his 
control becomes bang-bang, which means that he 
nuwes the control from owe side to Ifie other in an 
attempt to folU.nv the <m\ of the ^)icing function. 



This is a nonlinear characteristic of human 
operator behavior that is not adequately treated 
by many modeling efforts that assume operator 
linearity. 

Cue Utilization 

Studies in cue utilization have been largely 
concentrated in two areas- (a) use of visual 
position, rate, and acceleration cues and (b) effect 
on performance of adding proprioceptive cues. In 
the first area, Fuchs (1962) has provided evidence 
that as learning proceeds and/or as task-loading 
decreases, the human operator relies more and 
more on y<^focity and acceleration cues and less on 
positio><^ cues. This would explain why highly 
sloHed operators, are better able to lead the system 
and predict future events (by utilizing higher-order 
information). While this may be true for velocity 
information, there is some doubt that humans are 
really able to use acceleration as a cue, however. It 
has been found, for example, that accelerations 
and decelerations are usually inaccurately inter- 
preted as constant velocities (Adams, 1961). 

There is additional evidence to indicate that the 
use of velocity versus position - cues differs 
depending on the type of tracking task used 
(Briggs, 1962). In one Jtudy, for example, Walston 
.and Warren (1953) found that velocity infor- 
mation was used more in pursuit than in 
compensatory tasks. Thus, the relative utilization 
of velocity versus position data is certainly task 
dependent as well as proficiency dependent. 

In the second area, several studies have demon- 
strated that the addition of motiort cues results in 
a change in human operator control characteristics 
(Ringland & Stapleford, 1971, 1972; Shirley & 
Young, 1968a, 1968b). Even more interesting is 
the evidence that early in training, spatial and 
visual cues are most important, but later in 
training kinesthetic cues become more useful 
(Reishman & Rich, 1963; Summers & Ziedman, 
1964). This has important implications for training 
as well as for human operator modeling. 

Summary 

Several specific characteristics of the human 
operator have been identified which ouglit to be 
included in or otherwise accounted for in models 
to be used for i^rformance measurement. These 



include operator intermittcncy, or the processing 
of information at discrete intervals rather than 
continuously; psychological refractory period, or 
an interval of time following response to a 
stimulus when response to a second stimulus 
cannot be issued; range effect, or the tendency to 
respond as if the stimulus were of average 
intensity; inadvertent crosscoupling, or movement 
of a control in one axis when activity should have 
been limited to movement in another axis; bang- 
bang control, or the use of a pulsing control 
movement as the forcing function increases in 
frequency; and cue utilization characteristics, 
including the increasing use of velocity and 
acceleration information, as learning proceeds or as > 
task-loading decreases, the use of differen t control ^ 
techniques when motion is added to a simulator, 
and the possiblity tliat spatial and visual cues are 
more important early in training, with kinesthetic 
cues/becoming more useful later on. Some of these 
characteristics have more support than others in 
the literature. In models to be used for perform- 
ance measurement, these characteristics should 
either be included directly (particulariy those 
characteristics that are well substantiated) or 

.otherwise accounted for by allowing for their 
existence within the scope and assumptions of the 
model. In addition, general consideration should 
be given to associated traits of the human, some of 
which precipitate many of these * characteristics. 
These include the existence of observation and 
control errors, time variations in control strategy, 

^ threshold and saturation effects, preview and 
precognitive functions, variations in performance 
due to changes in attention and fatigue, and, 
generally, man's ability to remember, predict, 
reduce information, and make decisions. 

III. MODELING APPROACHES 

The ^ previous Section reviewed many of the 
human operator characteristics that ought to be 
considered in developing ^a valid model. This 
section and the next examine the various modeling 
approaches from the standpoint of how well they 
represent tliese characteristics and, thus, how 
suitable they are for performance measurement 
applications. 
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Describing Functions 

The L^ariicst attempts at human operator 
modeling were based on applications ol' describing 
function methods. Tliis approach evolved from the 
observation that many nonlinear systems behave 
Wki: linear systems when subjected to specific, 
controlled inputs (McRuer & Jex, 1967). Tlie idea 
then occurred that perhaps engineering analysis 
tools designed to study linear systems could be 
used to model tliose aspects of human operalOi 
performance for which quasi-linearity can ')•: 
-safely assumed. 

Description and Assumptions. A describing 
^-function model is essentially a differential 
equation relating the human operator's output, or 
movcnienl of the cpntrol, to his input. Excellent 
• descriptions of the model are provided by Kelley 
(1968b) and McRuer and Krendel ( 1974). The 
model is based on the observation that in a 
compensatory type tracking task with simple 
dynamics, the human operator performs in a 
manner similar to a scrvomechanism. An observed 
Qjror,. following a central processing delay, gives 
rise to a motor command that is applied to the 
control in a manner which reduces the error to 
/.ero. As Wickens ( 1974) observes, it is because of 
this simplicity that man*s behavior in some circum- 
stances can be closCly modelled . by describing 
function techniques. , . 

The describing function model i« one of a class 
of models known as quasi-linear in type, referring 
to a linear model which is employed to model the 
behavior of ffonlinear system. Tlie basic describing 
function accimnts for that part of the human 
operator*s response that is linearly correlated with 
the input signal. Its general form is 

0^,(t)+(TN+T,)e^Jt) + T^T,0^/t) 
, •=K(0.(t^.T) + TL0.(t-T)) 

where the terms are as described below: 

Operator Output (©o) is the actual control 
stick position aj activated directly by , the human 
operator. 

Operator Input (9|) is the stimulus to the 
human operator, usually consisting of some dis- 
platHjnicnt of a target or cursor from a reference. 
Tlie task is to minimize the displacement througli 
appropriate control movements. 



Neuromuscular Lag (Tn ) is tliat portion n^t 
delay between stinmlus and response that .i be 
attributed to dynamic characteristics of the liml. 
Nominal values are 0.1 to 0.5 second. 

Low frequency Lag (Tj) is a general constant 
introduced into the operator's response when low 
fre(iuency system response is important. Nominal 
vahies range from 1 to 20 seconds. 

Gain (K) is the amplitude ratio of output to 
input and is the operator's primary adjustment 
coefficient. 

Lead Time Constant (Tl) is the time into the 
future for which tlie operator is predicting the 
input and formulating an output. Nominal values 
vary from a fraction of a second to 1 or 2 seconds. 

Delay Time Constant (r) is proportional to the 
operator's reaction time delay. Nominal values are 
.1 5 to .20 second. 

The component of the output that is not 
linearly correlated with the input is referred to as 
the remnant (McRuer & Krendel, 1957). Tlie 
remnant reflects nonUnear aspects of operator 
behavior, and it is the existence of the remnant, 
the occasional application of tlie model in tasks 
which are not of the simple, compensatory variety, 
and the basic linearity assumption that have been 
continuing sources of criticism regarding this 
approach. Remnant is .usually described as an 
insignificant portion of control behavior which is 
unpredictable except in a statistical sense. Yet, as 
Levison and Kleinnian (1968) observe, this 
description of remnant is not valid in situations 
where the controller's response contains significant 
nonlinearities or amsistcnt time variations. 
Possible sources of the remnant are errors of 
observation, errors of control execution, time 
variations in control strategy, and structural 
deficiencies of the model. With the describing 
function approach, all such model and operator 
variants are lumped into the remnant and are 
indistinguishable from one another. 

The linearity assumption is that the human 
operator will respond to changes in the frequency 
of the input only, and that his response- will be 
essentially independent of tJie amplitude of the 
input. This assumption has been made **. . .so that 
the mathematical procedures applicable to transfer 
function theory can be used. Such application has 



persisted in spite of the general admission that the 
human operator is essentially nonlinear and that 
his representation by . a linear function is 
inadequate" (Bcare & Kahn. 1967). Known 
operator nonlinearities include threshold and 
saturation effects, dither, range effect, preview and 
precognitive functions, and parameter variability 
due to changes in attention and fatigue (Kelley, 
1968a). These onlinearities cannot be modeled 
using describing functions. This led Wherry (1969) 
to conclude that there is really little merit in 
applying describing function methods to describe 
human operators. He states: 

It is itiy personal rccMng that those who 
woiiUI have us believe thai man is just a 
fancy servo system u,r that he i'i like an 
;intopiloi have spent loo much time with 
machines and not e nough with rea 1 
operators in rcaJ systems. I'ven at the risk ol' 
offemJinj; some model builders. I feel 
ecmipcllcd to say that 1 am smgularly 
unimpp:ssed with the iran.sfer equation 
appruaeh. (Wherry, 1969, pp,,2 37) 

Tliesc seniiments are endorsed also by Poulton 
(i"''>2), who points out that describing functions 
merely give an exact numerical, value to tliose 
aspects of human performance that resemble the 
parameters of servomechanisms. However, they are 
not as suitable as simple measures are for 
detcnnining the details of the ways in wiiiclv 
human operators do not behave like scrvo- 
mcchanisnis: these include most of the phei\omena 
studied by psychologists." (Poulton, 1962, p. 320) 

Another assumption of the describing function 
approach is that the human is attempting to 
minimize error based on some constant, implicil 
error criterion (Sheridan, Fabis,"& Roland, 1966). 
In reality, the etror criterion that is applied varies 
with time as well as with the task. By incorrectly 
assuming constancy, the modeler observes these 
variations as changes in model parameters that are 
indistinguishable from changes arising Troni other 
sources. The model additionally assumes that the 
operator's attention to error is restricted to a 
single observation when, in fact, his behavior is 
influenced by both memory and prediction. 

Applications, Despite the rather obvious short- 
comings of the describing function model as a 
general- model of human behavior, many 
interesting insights have nevertheless, been 
obtained tlirough its application to tasks l\)r wliich 



it is best suited. Most applications have consisted 
of cither examining parameter variations under 
different task conditions or developing describing 
functions for new tasks. In the former category are 
a number of efforts to examine the effect of 
simulator motion on control technique as char- 
acterized by the describing function nuxlel 
coefficients- Most studies surveyed concluded that 
the addition of motion cues changes the manner in 
which control is executed (Shirley & Young, 
1968a,' 1968b; Stapleford, Peters, & Alex, 1969; 
Ringland & Stapleford, 1971, P 72). The observed 
changes in the model coefficients include greater 
values of lead and de^reaseti time delay when 
motion cues are supplied. Interestingly, and in 
distinct contrast, a 1967 study comparing inflight, 
performance with fixed base si^iulatoa perform- 
ance found no significant differences in model 
coefficients (Smith, H., 1967). Another study 
•tompared inflight performance using the real 
v^ual scene with single degree-of-freedoin 
si.mulator performance' using instruments and 
found lar^^e differences in model \coefficients 
(Newell, 1967)-, unfortunately, howeveV^, the cause 
of the differences (different motion or. different 
visual) cannot be determined from this study. 
Salmon and Gallagher (1970) found tliat in 
addition to a change in coefficients, moving base 
simulator performance produces more aileron and 
less elevator activity than its fixed base counter- 
part. The describing function ihodel has also been 
used in studies to examine differential effects of 
roll and yaw motion cues (Young & Dinsdalc, 
1969) and visual motion cues versus those supplied 
proprioceptively (Junker & Price, 1976). 

An extremely interesting group of studies was 
performed to determine whether or not the 
describing function coefficients change as a result 
of learning and, thus, whether they may be useful 
as measures of performance. TodoSiev, Rose, and 
Summers (1966, 1967) found that tlie lead time 
constant increased with training and was greater in 
two-axis tracking tlian in one-axis tracking, 
althoiigli no significant difference was observed in 
tracking error jxir axis. This illustrates tlie 
increased ,sensitivity that may be expected from 
model-based measures as opposed to conventional 
system measures. These findings were substan* 
tiated in 1967 in a study whici analyzed gain and 
time delay coefficients for t'ircc subjects over 
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several days of training and found significant 
changes (Jackson, 1%7). Burgctt (1969) varied 
this experiu'icnt by computing values ol' gain and 
lime delay every 20 seci)nds and confirmed earlier 
findings. In addition, he concluded- tliat the 
variance of the time delay is a more sensitive 
measure of learning than the mean value. Finally, 
the work of Pew and Rupp (1971) provides 
excellent confirming evidence of the sensitivity of 
model coefficients to learning and their utility in 
discriminating among subjects of different -ability 
levels for simple trackii^g tasks. 

In aiioiher group of studies, describing 
functions were used to study the effects on 
performance of divided attention and time sharing 
(Gopher & Wickens. 1975a. 1975b; Wickens. 
19 74. 19 7(>). It was found that gain was 
significantly decreased when time, sharing tasks 
were added to n primary task and that the size of 
remnant increased, indicating an increase in non- 
linear characteristics of perfonnance during task 
loading, io addition, it was found thai there is no 
reliable increase in time delay with the addition t)f 
a secondary task, suggesting that divided attentitin 
docs not necessarily lead to a;i increase in the time 
required to process information (Gopher & 
Wickens, 1 975a). The same type of result was 
fourul by Virije (1971), wlio noted no coefficient 
differences as i\ function of audit) versus visual ^ 
feedback, ;iltlu)Ugii it is commonly accepted that 
aural receptor delays are siiortcr than visual 
receptor delays. 

Other applications have included examining the 
effects of feedback on performance (Miller, 1965), 
the effects of predictive displays and varying 
amounts of preyiew (Dey, 1971: Reid & Drewell, 
1972), and the possible reasons for performance 
problems in pursuit tra'tking ( Reid, 1969). In all of 
the applications reviewed, it was clear that use of 
the describing furicliiMi model greatly aided 
performance analysis, notwithstanding the model's : 
known shortcomings ami limitations as a general 
nuxicl of humaji peiforivraice on highly complex 
tasks. ' . 

Revisions and l.stcnsions. A number of studies 
have bee^i performed in attempts to correct 
deficiencies of describing functions i)r to extend 
them to new applications. For example, describing 
functions do not work well for step inputs. Tluis, 
Hiatak and Weir (1968) pro|X)sed the addition of a 
bang-bang control capability to handle step inpiits. 



where the switching logic is a function of the order 
of the controlled element. Similarly, describing 
f u nc t it) n s are not a p plicable to nonlinear 
con t roll ed elements, and studies have ^Jf^\\ 
conducted to develop coefficient adjiJ/^tmcnt 
procedures for handling special nonlinear cases 
(Duggar, Manncn. & hannen, 1969). 

Another deficiency of describing functions is 
that they arc intended only to reproduce average 
operator performance, and a single instance of 
model output does not generally^ appear like the 
output of a human. Adams (1968) developed 
techniques to add random noise signals to the 
nu)ders output and to introduce time-varying 
gains in attempts to make the output appear more 
realistic. Comparisons of his modified model and 
the original model with actual human operator 
output show that his model appears to better 
replicate human data. 

Finally^ tlie describing function model was 
originally , intended for use in single-axis tasks, 
Levison and Elkind (1967) performed experiments 
to determine its applicability to two-axis tasks. 
Iliey found that two-axis performance is the same 
as one-axis so long as the control problems on the 
two axes are homogeneous and the displays for 
both axes can be viewed foveally. If displays for 
the two axes are separated, peripheral vision 
becomes important. They prtiposed a muitiaxis 
model coi)sisting of a simple combination of 
single-axis describing functions with the human 
operator modelled as a two-channel controller 
processing information obtpined foveally for one 
chaimel and peripherally on the otiter channel. 

Summary ami Critique. The motivation fo/ 
usi ng describing fiinetions to model human 
pern)rmance stemmed originally from (a) the 
desire to make use of highly developed linear 
systems analysis techniques and (b) the 
observation that Ibr simple tracKing tasks, human 
control is similar to the control method of a servb- 
Uiechanism. where an observed error produces 
some motor command designed to reduce the 
error to zero. Tlius. by assuming tliat much of 
human perfonnance is linear TiTr the tasks to be 
studied, ii describing - function model can be 
formulated which relates the linear }H^rtion of the 
human's output to the input by means of a 
differpritial equation. Tliat |X)rtion which is non- 
linear is relegated to a renmant tenn in the nuxlel. 
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with tlie. assui:ipti()ii that U^r most tasks the 
remnant wilt be negligible and will eonsisi only of 
random typo components of ti)c output that, 
except in a statiJiXical-Vrrse. cannot be modeled 
anyway. 

The describing t imet ion approach has provided 
a quantitative method of analyzing perfornKince 
and providinu insights about beh'wior on the 
simple compensatory tracking tasks to which it is 
applicable. However, these tasks comprise only a 
small percentage of the real-world tasks of interest . 
and the lasociated performance is :")f relatively 
little interest. As might be expected, the. tempta- 
tion to apply describing functions to more 
complex tasks lias been irresistible, and it is here 
that justifiable criticism of tlie approach has been 
levied. When [Xjrforming any but the simplest 
tracking tasks, humans are higlily nonlinear in 
their performance. Thus, the linearity assumption 
upon which describing functions are based is 
violated and results of their application are 
suspect. Some of the nonlinearities which arise are 
observation and control errors, time variations in 
control strategy, threshold and saturation effects, 
dither, range effects, preview and precognilive 
functions, 'and variations in parameters due to 
changes in attention and fatigue. 

When nonlinearities if^'the pcrfonnance arise, 
the remnant term grows because a smaller percent- 
age of the overall output can then be linearly 
related to the input. Because of this, some 
attention has been devoted to modeling the 
remnant term itself (Levison & Kleinnian. 1968). 
While the inten' here is worthwhile (i.e., account- 
ing for more an/ more ot the operator's output), 
these efforts are less than satisfactory for human 
operator modeling because instead of attempting 
to develop a flexible and accurate basis for a 
model, the intent is to convert an inherently 
limited and inaccurate model into one of merit by 
adding various features. This may produce an 
improved mathematical prediction of human 
response but it cannot be expected to result in a 
valid model of the human. 

Based on the above considerations, the 
describing function approach appears to have 
little, if any, utility as a basis for performance 
measurement. Dye to the assumptions on whiclUt 
is based* it is applicable to only a small percentage 



o f the . tasks of interest in manual control. 
Attempt}^ to extend it to more complex tasks give 
(| iiestioiiable results due to violation of the 
iip^crlying assumptions, it is inherently inviable as 
a general model ol human performance because of 
the simplistic view of behavior upon which it is 
founded. Attempts to improve its accuracy and 
extend its ranj;;e of applicability arc of quesiion- 
able merit because they arc oriented toward 
improving mathematical prediction capabilities 
with little or no regard for assuring model validity. 

Optimal Control Model 

An optimal cont/ollcr is one which controls a 
given process in a \\tiy which minimizes some cost 
or criterion function while satisfying a set of 
constraints (Sheridan it Ferrell. 1974). In the early 
I960's, it was discovStfd tliat the mean-square 
error from human tracking data approximated the 
mean-square error of various optimal controllers. 
Since then, considerable interest and research has 
been generated for developing an optimal control 
ii'rodel of the human operator. As Sheridan and 
Fcirell (1974) observe, the idea is attractive 
because it is based primarily on the (sensible) 
assumption that if the h urn an ope ra t or is 
intelligent, he will attempt to behave optimally to 
the best of his ability. 

Description and Assumptions. An optimal 
control model is a computer model consisting of 
several distinct operations which, collectively, are 
designed to simulate human control behavior. 
Excellent technical descriptions are provided by 
Baron and Kleinman (1968), Kleinman, Baron, 
and Levison (1969), and Kleinman and Phatak 
(1972). The model is based on the assumption that 
a well-trained, highly motivated human controller 
behaves optimally subject to his own inherent 
limitations and the task requirements. Figure 1 
and the following, associated description explain 
how the mod^l basically works: TliC previous 
control action, /j, affects the vehicle dynamics to. 
produce a new system state,/ X, which is displayed 
to the operator as Y. Subject to some observation 
errors or "noise" and a time delay, r, the human 
observes the available information. He deduces the 
true veliicle ,state from the available information 
(the role of the Kalman estimator and the 
predictor). He then applies a set of gains. C*,that 
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operaic on the predicted state to produce, a desired 
control resposnes, {Ji^:. The gains are chosen to 
ininimUe a **cost functionaP' wliich relates the 
'human's control objectives to the task being 
performed. The desired control respojise is then 
acted upon by motor **noise'' and neuromuscular 
dynamics.;© produce the actual control action, ^. 

The major assumptions of the mixlei are that 
the human behaves optimally and that he 
minimizes some cost functional. It is the existence 
and nature of the cost functional that has been the 
source of nluch criticism. One problem is that the 
cost functional is assumed to be some quadratic 
function, both for mathematical convenience and 
because quadratic criteria seem to work well lor a 
broad range of problems (Sheridan & Ferrell, 
1974). However, the real form is unknown. By far 
the more serious problem is that no one knows the 
nature (parameters and constants) of the cost 
afunctional (Obermayer & Muckler, 1964). While it 
niijy^e true that the human is optimal for some 
criterion, determining that criterion is quite 
another problem. 

X 

Another so^I^c of criticism about the optimal 
control model is matit is not identifiable (Pliatak, 
Weinert, Segall, & DaK 1976). This means that 
there are so many parafneleijs that a unique^ value 
for each one cannot be deter>nmed. Instead, the 
parameters must be estimated byei^ipirical "rules 
of thumb'' and then iterated upon until a 



satisfactory fit of model predictions to actual data 
is obtained (Phatak & Kessler, 1975 ). 

The in o d e1 assumes that the hum an's 
. observation of state variables is inaccurate due to 
imperfections in the visual process* and various 
time delays. It further.assumes that the operator is 
a>yarc of the existence of imperfections and delays ' 
and that he attempts to compensate for them. In 
this respect, the model is much more sophisticated 
than the describing function, 

Applicatiom. The optimal control model has 
been applied to a variety of tasks, althougli not 
nearly so .many as describing function models. 
What is most interesting and encouraging is that it 
has been used successfully to model performance 
on complex as well as simple tasks. For example, 
the model was used for a study of closed-loop 
performance in an air-to-air combat task, and 
excellent agreement resulted between model data 
and actual data (Harvey & Dillow, 1974), In 
addition, the model has been used for a variety of 
uniqiie studies that could not have been conducted 
without great difficulty otherwise. In one effort, 
the model was extended to simulate the task 
interforence th^t would be experienced when 
performing several tasks simultaneously. It was 
assumed that tlie human is a parallel processor 
with a fixed number of channels, and various 
sensory inputs were selectively contaminated vvith 
white noise, Tlie effect of requiring the subject to 
perform several tasks was emulated by increasing 
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the effective observation noise ratio associated 
with each component task (Levison, 1970). . 

In another effort, measures of pilot workload 
were developed by computing weighting terms for 
possible workload parameters in tlie optimal 
control model (Wewerinke, 1974). These measures 
were demonstrated by computing the ''percent of 
effort'' associated with processing rate as com- 
pared with position information. Unfortunately, 
the workload indices were task dependent and 
several calibration runs were needed to determine 
tlie operator's "full capacity." Additional work 
based on the computation of operator workloads 
using the optimal control model has been 
suggested but not fully pursued (Baron & Levison, 
1975). 

Tlie model has been coupled with a fliglit 
simulator iiuxlel to analyze maneuvering fliglit 
Kinhility boundaries (Brpussard & Stengel, 1976). 
i.\ llent agreement was obtained between actual 
and predicted stability boundaries as evaluated in.^ 
follow-up studies involving actual flight testing 
(Stengel, 1976).. In addition, the model has been 
used to ynaly/.e the utility of various xockpit 
displays for the DC-8 aircraft (Kleinman& Baron, 
1971). Again, excellent agreement was obtained 
between - actual and predicted data. In less 
successful studies, attempts were made to use the 
model for simulating performance of a vertical 
takeoff and landing (VTOL) hovering task (Baron 
^& Kleinman. 1971; Baron, KIcinnian, Miller, 
Levison, & Elkin, 1969). Ifowever, in this instance, 
poor agreement between model and actual data 
was obtained for various regions of control. 

By far the most interesting application of the 
optimal control model and the theory on which it 
is based has been to try to determine (compute) 
the nature of the cost , functional for a given 
'individual or group. aXhis has been named the 
''inverse optimal control problem,'' and its 
solution would have tremendous utility in studies 
Of human behavior. In normal applications of the 
optimal control model, different cost functionals 
are selected on the basis of judgment and are tried 
until something which seems to work best is 
identified. Since the choice of the cost functional 
is arbitrary and subjective, it may be pointless to 
expend too much effort in finding a control law 
which can ^inly be assumed correct in some 



restricted sense (Obermayer & Muckler, 1965). 
Instead, it may be more worthwhile to channel 
this effort toward discovering the true cost 
functional for the task and individual at hand — 
hence, tlie inverse optimal control problem. 
Anderson (1974) computed weighting terms for 
the parameters in a quadratic cost functional for 
many vehicle configurations using conventional 
model fitting techniques. He concluded that a 
universal cost functional does not exist, suggesting 
that the cost functional depends on at least vehicle 
dynamics ai^nd probably the task and the individual 
as well. This supports the contentions of 
Obermayer and Muckler (1965) that it may be 
fruitless to try to assume some universal cost 
f unctidhal and deduce a valid control law. 
Additional empirical support has been generated 
by showing that optimal control model parameters 
change for a given subject depending- on 'his inter- 
pretation of "optimality" as infiuenced by verbal 
instructions regarding task objectives (Obermayer, 
Webster, & Muckler, 1966). Unfortunately, the 
inverse optimal control problem .^s mathematically 
nontrivial and has so far defied numerous attempts 
at its solution. " . 

'-Rvvisions and Extensions, Most of the active 
research involving the optimal control model has 
centered around its direct application to new 
problems and not'on its revision or extension. One 
of the few exceptions is some work to configure 
the model to handle the decision-making tasks of 
pilots (Levison, 1971). This was performed in 
recognition of tJie fact that continuous manual 
control is only one of the functions performed 
during Right. The model extension consisted of 
replacing the computation of gains and subsequent 
determination of a control action with a decision 
algorithm based on Bayesian-statistics. For single 
and double decision tasks, the model produced 
data that agreed fairiy well with data from four 
subjects. However, for simultaneous control and 
decislon-making, there Avas such a large subject-to- 
subject variance tliat tlie predictive ability of the 
model could not be assessed. 

3.' 

In another study, it was proposed that instead 
of attempting to minimize tlie total cost 
functiop'^l, what humans really do is to minimize 
the number of instances where there is an increase 
rather than a decrease (a) between the present 
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rK)silion and the objective and (b) in the accumula- 
ted cost (Hiomas & Tou. 1%6). Tlic proposed 
model revision Tor iinpicnienting this theory 
consisted of a new method lor determining tiie 
correct control action based on use of :\ search 
algorithni which operates under tlic above 
n>ini mi/at ion constraints. Tlie work did not 
include actual model implementation and test. 

Wicrcnga (1969) has contended that modelers 
have paid too much attention to the -nan as a 
controller at the sacrifice ofadequ; aiiontion to 
his . perceptual mechanisms. He |H)Stulatcd that 
transformation of raw displayed information into 
a useable form is performed :is an ^jptimal. time- 
varying Kalmari tiltcr. He implemented this ihcory 
as a revision to the optimal control model and „ 
successfully demonstrated its feasibility. 

• One of the most interesting efforts involving a 
revision' of the optimal control model was one 
performed in 1976 for the purpose of reducing the 

'number of parameters and thereby making the 
model identifiable (Phatak ct al,, 1976). The 
author'i contend that^^ the model is over- 
paramctcn/.ed because its assumptions about the 
human'* arc overly stringent. They further contend 
that the standard optimal control uukIcI attempts 
to be isomorphic to known characteristics of the 
human and that this, in turn, results in some 
effects cancelling others in the long run (e.g.. time 
delay in observation and then ^nediction of true 
state estimates from the dela>u.Hl observations). 
The model developed by Pliatak and associates 
involves four simplifying modi Heat ions- (a) 
Assume time delay to, be zero; (b) assume the 
human" tibservcs the displayed variables alone and 
not their rates; (c) assume zero motor noise: and 

"(d) assume no control-rate term in the c(^st 
ftmctional, I'or various reasons, all these modifica- 
tions result, in a greatly simplified model which can 

^be identified. The authors admit that their revised 
model has no isomorphism to human information 

. processing and psych ophysiology but quickly 
point out that ''isomorphic models are of no use if 
their parameters cannot be identified" (Phalak et 
al.. 1976, p. 34). Tlic idcntifiahility of the revised 
model was demonstrated but exl endive testing of 

' its validity has not yet occurred. 

Suinniarv and Oitiquc. The optimal cimtrol 
>nodel is based on the a.ssumption that the higlily 



trairied and niotivatcd operator will behave 
optimally subject, to his own limitations and basic 
task constraints. Optimality is defined as 
minimi/ing some Cost functional, which ii; 
formulated to represent the "cost" of the 
performance in terms such as error, time, energy, 
etc. The model itself consists of a munber of 
operations which are sequentially executed on a 
computer and wliich are isomorphic to known or 
postulated human characteristic^ and activities in 
performing a task. For example, one part of the 
model represents the time delays involved in visual 
perceptions and another represents the belief that 
the human predicts a best estimate of the true 
state of the system based on his awareness of his 
own imperfect perceptions and time delays. v 

The major criticisms of the model have con- 
cerned the existence and naturp^oT^he cost 
functional and the large n|nnbe'r of parameters in 
the model. Tlie form and content of the cost 
function al a re only conjectured, and it is 
conicpded by some that it is fruitless to devote 
much effort to the development of a model with 
only restricted applicability due to uncertainty 
regarding this issue. The issue uf iwer- 
parameterization concerns the lack of a unique 
solution for the parameters of the model because 
of their number. In practice, it is necessary to fix 
several parameters based on best guesses and then 
r solve for 'remaining parauAelers. iterating on this 
process until what is judged as a "good" model is 
found. 

Applications of the nuxlel have bccn^^^ite 
successful and diverse. It has been used for air-Vv 
air-combat nuideling. pilot workload compuiat>oii. 
determination of fiight stability b(Mmdarie,s, and 
evaluation of alternative flight displays. One of the 
most interesting applications has been to try to 
* experimentally determine the nature and para- 
meters of the cost functional, alternatively known 
as the inverse optiinal control problem! At least 
one investigator (Anderson, 1974) has concluded 
that t here is no universal cost functional, 
supporting previous contentions that it is not a 
viable appro^rich to a.ssume some universal cost 
finictional and expect to derive a valid control law*. 

Prin^^ipal. uses of the.uiodcl have been direct 
applicaticMis to new problems with a minimum 
number of revisions and extensions. Some 



exceptions are efforts to extend it to decision 
making tasks, revisions to the bases, for selecting an 
optimal control action, and the addition of pre- 
processing on the displayed signal to better 
simulate the human's perceptual processes^ In 
additign, a major simplification of the model has 
been attempted to correct the problem of. over- 
parameterization. 

The optimal control model represents a number 
of real or intuitively logical characteristics of the 
human operator. This is at ^e expense of 
identifiabi)ity,. however, and in attempts to reduce 
the number of parameters, several of the simulated 
characteristics had to be omitted. Thus, it seems 
that to tnake derivation of the model's parameters 
completely rigorous from a mathematical stand- 
point means a necessary loss of essential, aspects of 
. the model's content validity. 

The most serious shortcoming from the stand- - 
point of applying the model for measurement 
applications lies in the cost functional and. the 
associated assumption on which it is based. First, 
the model parameters are extremely sensitive to 
the cost functional. The fact that the nature and 
form of the cost functional can only be con- 
jectured makes it impossible to place much 
reliance on the resulting model parameters In 
general measurement applications. It is possible, 
however, that the model may be useful in carefully 
controlled exjperiments where (a) the true cost 
functional is of no interest and (b) the subjects can 
be instructed to perform in accordance with the 
dictums of the assumed cost functional without 
compromising the results of the experiment. 

In addition to the above shortcoming, the 
basic assumption of the model contraindicates its 
use in performance measurement, that is, the 
assumption that the highly trained and motivated 
operator will behave optimally. In measurement 
applications, the concern most of the time is wit|i 
the untrained operator; there can be no assurance 
that he will behave optimally nor even that he wQI 
attempt to. minimize the same cost functional as a 
trained operator will, granting that a universal cost 
functional for any group of operators even exists. 

Thus, ^ the optimal control model does not 
appear suitable for investigating behaviors for 
which it was not designed, such as those involved 
in learning. Therefore, it is not suitable for general 



measurement applications. Its forte lies in the 
study of optimal behavior of higlily trained 
operators, but even here the computation of 
parameters lacks complete rigor due to o^er- 
parameterization. It. is possible that simplifications 
as proposed by Phatak et al. (1976) may be useful 
in solvTtig this problem. Possibly the most 
interesting application of the model in the area of 
measurement and training is in studying the 
inverse optimal control problem. However, this 
problem is not trivial and, so far, a general 
solution has not been discovered. 

Discrete and Finite 
State Methods 

. Most of the mathematical models discussed so 
far are based oti the assumption that the human 
observes a continuum of input states and produces 
a continuous stream of outputs. Several investiga- 
tors have taken issue with this assumption, 
claiming that the observations and decisions which 
determine successive outputs are discrete rather 
than continuous" events. As a result, various 
theories fiave been proposed regarding issues such 
as the bases on which decisions are made, man as a 
sampled data system as opposed to a continuous 
regulator, and man as a finite state machine. 

One of the principal promoters of the theory 
that man acts on the basis of discrete observations 
and decisions was Bekey who, along with various 
g^sociates, developed several novel modeling 
concepts. As early as 1962, Bekey proposed that 
the human's output in a manual control task is 
intermittent, consisting of a series of ballistic 
responses triggered at intervals of about .5 second 
(Bekey, 1962). Referencing the earlier work of 
Craik, Bekey developed a simple model/based on 
this assumption and showed that it was capable of ' 
producing outputs more representative of real 
performance than contemporary linear, con- 
tinuous models. Stimulated by this early work, 
Bekey investigated* the effect of using a random 
sampling interval, finding it produced outputs that 
appeared more realistic (Bekey & Biddle, 1967), 
This supported the earlier efforts of Pew (1960). 
In associated studies, a model was proposed where- 
in the human is assumed to quantize his input and 
output into a finite number of states, and data are 
processed using asynchronous samples of this 



coarsely quantized input (Angel, 1967; Bekey & 
Angel. 1966). Iliese assumptions permitted the 
use of the highly developed theory of rtniie state 
machines. The wi)rk was also based on the 
assumptions that the human clianges states, 
depending on quantized observations of error and 
crro. rate, and that a response, once niitiated. 
cannot be interrupted but must run to completion. 
Tliis initial work consisted primarily of developing 
modeling rationales and proposed modeling 
constructs, 

Fxpcriments were conducted to study the 
control response amplitudes and pulse -widths in an 
attempt to specify a model representative of the 
foregoing theories (Mcrritt & Bekc\ . 196Y) As a 
result, it was concluded that sometime near the 
completion of, an output pulse, monitoring of 
error and error-rate begins. When the error 
trajectory enters some preselected region of,. the 
phase plane, a decision to produce a new pulse is 
made and. sometime later, is executed. Merritt 
went on to apply some of thesp discrete modeling 
concepts to visual scanning behavior (Merritt. 
1968), while Angel and Bckey pursued the further 
development of a finite state model of manual 
control (Angel & Bekey. 1968). In the latter 
effort, the assumption was added that the human 
has a library of four force programs, any one of 
which can be triggered based on phase plane 
observations. Although the results of the 
associated modeling experiments looked 
promising. , no comparison with actual human 
performance data was made, and an objective 
evaluation was not presented.. 

Other active promoters of finite state machines 
for modeling rftanual control behavior were Fogel 
and Moore. Their work resulted in a finite state 
model of human performance ;n fliglU control 

' tasks, including a representation of reaction time 
delay (Fogel & Moore, 1968a). Model outputs 
were compared with those produced by a linear 
pilot model, a nonlinear model, and a human. Tlie 
results were excellent. A detailed description of 
the model showed that input data were quantized 
into 64 elements and a 64-state machine was used 

. (Fogel & Moore, 1968b). State transitions were 
fixed (next state is present input), and outputs 
were computed statistically. Thus, much of the 
success can be attributed to the large size of the 



machine, and a direct correlation could be' 
anticipated between the number of states and the 
accuracy of results. 

The notion of using finite state machines was 
also pursued to develop an adaptive gain changer 
in an aircraft stability augmentation system 
(Burgin & Walsh. 1971). Walsh had performed 
earlier woik with Fogel and was undoubtedly 
influenced by previous experiences with finite 
state machines. The actual machine developed is 
only sketcliily described; however, it was 
constructed by adjusting outputs to minimize a' 
cost function representing the difference between 
real and model-computed gains. 

The use of c'screte decision events in operator 
m o d e ling was also proposed by Poul ton to 
produce outputs corresponding to higli frequency I 
input components that more nearly mimic man 
(Poultoii, 1967), He suggested that the human 
makes decisions about eveiy .5 second and that 
there must exist two models (compensatory and 
pursuit) to fully represent a given performance. 
According to Poulton, the latter is due to the 
likelihood tliat the man's internal compensatory 
model is kinesthetic while his internal pursuit 
niodel is'visual. 

In another effort, Preyss developed a theory of 
human learning behaviop based on a single, channel 
assumption involving discrete response selection 
(Preyss, 1968). He tiieorlzed that a priori estimates 
of the probability that a specific response is.' 
appropriate are stored in memory. Response 
selection is a decision process which uses the prior 
estimates, and learning consists of revision of the 
priors based on the weighting of certakr evidence. 
A model based on this tlieory was developed for 
performance of a relay control task. The ensuing 
experiments supported acceptance of the nufl 
hypothesis, but follow-up studies ^were not 
conducted. 

More recent applications of discrete modeling 
coiicepts include development of a model of the 
helmsman of a supertanker (Veldhuyzen, Van 
Lunteren, & Stassen, 1972). Here, studies were 
conducted to determine decision rules for making 
discrete adjustments in the wheel position. The 
study revealed extensive intersubject variance, on 
the. parameters believed to be essential 
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independent variaWes. Finally, other investigators^ 
have pursued the idea of using the phase plane as a 
medium for specifying decision criteria 
(Jagacinski, Burke, & Miller, 1976). This study 
showed that as learning proceeds on a manual 
control task, the decision locus in the phase plane 
approaches that emi^oyed by a theoretically 
optimum controller. 

In way of critique and finafl comment, ^many 
good ideas have been proposed for modeling all or 
part of human performance as a discrete process. 
Much theoretical evidence and some empiric^ data 
suggest that such concepts as input quantization, 
response intemiittency, and discrete' observation 
and selection of output reisponses have merit. At 
least part , of the problem in implenientmg these 
concepts lies in 'the difficulty in mathematically 
modeling discrete as opposed^ to continuous, 
events. Attempts to use' existing' tods," sudi as 
finite state machines, have enjoyed some success^^ 
but very large modds were necessary^.uStudies that 
have been done to try to characterize the decision 
criteria used to govern changes in the response 
have been very valuable. In particular, the phase 
plane has been used ^extensively to determine the 
boundaries of regions in which control response or 
some aspect thereof remains •fixed. 

Adaptive Techniques 

One very important humain trait which models 
discussed so far have not addressed js ad apt at i on 
In performing complex tasks, it is unlikely that the 
. operator selects a , fixed, control technique and 
applies it without change for the duration of the 
task. Instead^ he adapts his technique ^depending 
on the acquisiytion .of new knowledge ^about the 
task, inst^tanepiis task requirements, arid other 
concurrent jobs that compete for his attention. 
Studies of operator adaptation are especially 
relevant to .performance measurement 
applications, because learning a control ta^k may 
|7e viewed as a succession of adaptation processes. 

M(^t efforts iii adaptive modeling are oriented 
toward the control of systems ^having complex 
aiid/or time-varying dynamics. In one such study, 
the adaptive process waS' characterized by four 
phases' (a) Detection of a <:hange in the vehicle 
dynamics or environnient which necessitates a 
chainge in control; (b) idehtification of the charac- 
teristics of the^ new situation and stabilization of 



the vehicle; (c) reduction^df accumulated enors; 
and (d) optimization of dynamics (Elkind, K^lly, 
& Payne, 1964). Detection was^ modeled as a 
threshdd identification process based on error 
-alone, while identfication was based on an 
estimation of the relationship between stick move- 
ment and error position, rate, and acceleration 
(Elkind & Miller, 1966). An adaptive model 
incorporating these phases was proposed. The 
model also included assumptions that position and 
velocity are directly perceived, responses are 
i n t e r m it tent , and bo thi pursuit and saccadic 
channels exist. Some studies were performed to 
empirically determine -how changes in control 
dynamics are detected (Miller & Elkind; 1967). 
However, full test and validation of the proposed' 
model was not accomi^shed. ct? : 

In another similar study, attempts^'^^^g^ade 
to identify the decision process used by humans in 
detebting a change in control system dynamics 
(Phatak & Bekey, 1968; Weir & Phatak, 1966). 
Here, it w^s assumed that >tfie Human operator 
recognizes certain 'pattern features in the error 
versus error-rate phase plane. The phase plane was 
divided into regions, and 'studies were conducted 
to try to identify a valid decision process based on 
asking yes/no qu^tions about the region currently 
active and trends of error and error-rate (Phatak & 
Bekey, 196^>). Complete pursuit of this modeling 
idea through the validation phase did not occur, 
although some interesting concepts were devel- 
oped. ^ 

En another study to develop adaptive control 
methods for time-varying dynamics, it was 
proposed that the human operator works in terms 
of a string of control intervals (Knoop & Fu, 
1964). In attempting to track a^welt as possible, 
the human attempts to shorten his control 
intervals, within each of which*bang-bang control, 
is used. The amoutits by which intervals are 
reduced are bounded Selow by the system delay 
time. It was further hypothesized that the human 
^ forms an internal model of the plsint, subjects it to 
the same forcing functions, and uses its^response 
to predict system response. He then compares this 
with actual system response to identify changes in 
plant dynamics. This is accomplished at the end of 
each control intervaT. Experiments were conducted 
to establish basic feasibility of the model and 
develop methods of obtedning model parameters. 



It was concluded that the control intervals are 
rclutiveiy constant in length and tiiat the model 
has potential for explaining adaptive behavior. * 

Other studies huve been conducted on adaptive 
modeling methods, but most are variations or 
extensions of those discussed above, [-or example, 
Niemela (1974) worked to experimentally derive 
boundaries of regions in the phase plane where the 
human perceives a change in vehicle dynamics. 
Interestingly, another study in the same year 
concluded that subjects are not able to consciously 
detect changes in dynamics as soon as they are 
made, although they change tliefr control 
characteristics almost immediately (Moriarty, 
1974). Gould and Fu (1966) proposed a three-part 
adaptive model involving the process of identifica- 
tion, decision, and modification^ However, the 
model was not developed and validated. 

In way of summary' and critique, a number of 
interesting concepts have been developed in 
attempts to make models adaptive. These concepts 
are of interest in performance measurement 
because learning can be viewed as a sequence of 
adaptations. Most of the adaptive modeling work 
has been oriented toward situations involving 
time-varying plafrf dynamics, and efforts have been 
concentrated on determining valid decision rules 
for detecting a change in dynamics. For example, 
attempts have been made to i^terrnine regions of 
the phase plane between whtcH transiticins cue 
operl[lor that plant dynamics have chan^^ 
Although ^?5me good ideas have been j:onceived in 
these efforts, none has been pursued far enough to/ 
fuljy^ validate the associated model, and only a few 
hive been pursued past the proposal stage. 

Preview Madels 

Conventional' models such as describing 
function^ and the optimal control model do not 
cope with preview and are not generally able to 
model performances where the* operator is privy to 
preview information. However, preview occurs in 
most of the complex tasks of interest in flying 
training, for example, and efforts to accommodate 
jt_^ a model are of considerable interest. Un- 
fortunately, only a few studies were found where 
the modeling of^evie\y behavior was of prithary 
interest/^' " * / 

4 Sheridan and associates note that, "The 
human's transfer function for response to a 



predictor display is not amenable to conventional 
filter discovery analysis since his dynamic response 
at each instant is not determined by a single valued 
function of time'' (Sheridan, Johnson, Bell, & 
Kreifeldt, L964, p. 230). They propose that one 
way of accounting for preview is to assign 
weigliting factors to each point, from the present 
to some realistic, observable limiting point in the 
future, and then use the weighted value of the 
input to deter mine the next response. In 
ratio^i/^ing this approach, they present an 
analogy of turning a cat into -a parking space. The 
initial trajectory is arbitrary but the final one is 
not, the error tliere being far. more important. 
Still, the initial trajectory must be.' chosen to 
minimize the expected error in pj^iSfis .where it is 
relevant — thus the use of independent weighting 
factors. The relevance of this concept to ether 
* tasks is of irfterest for, as Sheridan observes, -*It is 
evident that uniformity of error importance is 
indeed a very unusual situation in human control 
tasks such as driving vehicles, walking, using tools, 
and most things people do" (Sheridan, 1966,, p. 
92). 

Unfortunately, little was done in the way of 
validating any preview models based upon th&se 
concepts. Only a few other studies of preview 
control behavior were cited; these were largely 
thesis topics and were apparently not pursued in 
depth (Sheridan & Ferrell, 1974). The idea of 
incorporating preview control by, appropriately 
weighting the inputs representing the preview area 
is noveU but identifying the best weighting 
> function is not a trivial job and would probably be 
task-dependent. Therefore, considerably .morq 
research on preview modeling is necessary before it 
would bf a serious candidate for use in perform- 
ance measurement applications. 

Other Nonbnear Approaches 

Despite the fact t^at the human has long been 
known to be '^p^onlinear in most behavior, 
surprisingly little research has been performed in 
. developing nonlinear models. A possible reason is 
provided by Pitkin: 

Most liicely, this is due to the fact that 
control engineers can deal with finear 
models expressible in terms of transfer 
functions with much greater facility than 
' nonlinear' models; that these models are 
fairly easily derived from experimental data 



with cross correlation techniques; and, 
furthermore, that in situations wherein the 
operator behaves in a quasi-linear fashion, 
the use of a linear model is a most appro- 
priate engineering approximation. (Pitkin, 
1972. p. 11) 

A good example of readily observed nonlinear 
behavior occurs in tracking tasks involving 
acceleration-control. Here, it is well known that 
the human operator resorts to a pulsing o\itput 
behavior, presumably to develop enough lead to 
enable control to be exerted. Linear models have 
attempted to account for this by using an 
adaptable lead-lag term. This can provide the 
necessary lead by properly adjusting parameters; 
however, it does not result in the distinctive pulse- 
like behavior observed consistently in the human 
(Pitkin, 1972). 

According to Pitkin, the earliest work in non- 
linear 'modeling was performed around 1958 by 
Oiamanttdes (Diamantides, 1958). He developed a 
model which inserted a step function into the 
output each time the error crossed the zero point. 
The step preceded the reaction-time delay element 
and resulted in generation of a lead pulse. 
Oiamantides also injected dither into the output 
and included a^ threshold on the error-plus- 
derivative signal. 

Ten years later, Costello developed a two-mode 
surge model which constitutes the basic idea upon 
which much of the subsequent work in nonlinear 
modeling has been based (Custello, 1968). This 
model used either conventional linear dontrol or a 
surge control (pulsing output) depending on the 
magnitude of error versus error-rate (phase plane 
position). This modeling concept was applied later 
by Johannsen (1972), who added a third control 
mode consisting of constant output. Comparison 
of the output of this model wjth that of a human 
and a describing function model clearly revealed 
its superiority over the describing function in 
predicting human response. (Johannsen, 1972). 
Equally promising results were achieved by Pitkin 
with a model based on use of a linear controller 
plus a threshold feedback unit, where large, 
negative feedback of the output resulted in 
initiation of a pulsing action (Pitkin, 1972). 

Beyond these studies, little has been 
accomplished in nonlinear modeling that is of 
potential utility in measurement applications: 
Nonlinear analysis is at a stage of infancy 



compared with linear analysis, and perhaps this 
accounts for the fact that little headway has been 
made. The work discussed above consists of adding 
additional control modes to the conventional 
linear mode and determining which to apply on a 
sample-by -sample basis lising error and error-rate 
information. Results are sufficiently promising 
that these techniques are worth pursuing further. 
However, progress so far is limited, and tnuch 
work remains to be done to investigate the validity 
of proposed methods before they can be 
considered candidates for measurement 
applications. 



IV. ASSESSMENT OF 
, EXISTING MODELS 

Several human operator characteristics have 
been identified which ought to be included in or 
otherwise accounted for by models to be used for 
performance measurement applications. These 
include operator intermittency ; the existence of a 
psychological refractory period which is best- 
explained by the single diannel theory of 
behavior; range effect; inadvertent crosscoupling; 
bang-bang control characteristics; and differential 
use of various cues at various times and circum- 
stances. Associated traits of the human, some of 
which precipitate many of these characteristics 
and which ought to be considered, are the 
existence of observation and control errors; time 
variations in coatrol strategy; threshold and 
saturation effects; preview and precognitive 
functions; and variations in performance due to 
changes in attention and fatigue. 

Describing function models incorporate 
virtually none of the above characteristics. 
Furthermore, they are based on assumptions of 
" operator linearity which are in direct contradiction 
of several of 'ttie characteristics. Describing 
function models were designed to be applicable to 
simple"^cQmpensatory tasks, but these tasks 
represent only a small percentage of the reaW world 
tasks of interest. Attempts to extendTihese models 
to other applications have not been successful. 
Therefore, these models have no anticipated utility 
as a basis for general rneasurement applications. 

The optimal control model incorporates a/ew 
selected operator characleristics, most notably the^ 
existence of observation and control errors. In 
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addition, it is based on a viable theory of behavior 
or a highly trained operator. To a greater extent 
than any other nuxlel reviewed, the optimal 
control model attempts to incorporate identifiable 
modules which are isomorphic to reasonable 
hypotheses about ihiman behavior. The most 
serious shortcoming of the model from the stand- 
point of its potential use for measXUement 
applications lies in the optimality assumption and 
the related cost functional. The former is an 
assumption about the higlily trained operator, 
whereas in niost measurement applications tlie 
interest lies primarily in the untrained operator. 
The true nature of the cost functional (for the 
higJily trained operator and certainly the untrained 
operator as well) is unknown, and since it 
intluences the model parameters, its conjecture 
gives poor assurance of their validity and^ reli- 
ability. Therefore, this model is not considered 
suitable for general measurement applications, 
althougli it seems fairly well suited for studies 
involving highly trained operators in which use of 
a specific cost functional can he experimentally 
controlled. 

Discrete and finite state models incorporate 
various human operator characteristics such as 
in termittency. single channel behavior, input 
quantization, and discrete observation and 
selection of output responses. Unfortunately, the 
related work has not yet progressed far beyond the 
breadboard stage in many instances, and what has 
been performed suggests that implementation 
problems may be the cause. There is a distinct 
difficulty in modeling discrete, as opposed to 
continuous events, and it is possible that the 
necessary modeling tools are just not yet higlily 
enough., developed. Tlierefore. those modeling 
methods are not sufficiently far developed for 
justifiable use of any one as a point of depature 
for measurement applications. 

.Adaptive models are of considerable potential 
interest because learning can be viewed as a 
sequence -of adaptations. Related modeling work 
has been primarily oriented toward accom- 
mcxiation of time-varying plant dynamics. Several 
good ideas have been proposed for this particular 
type of adaptation: however.. no attempt has been 
made to incorporate the human operator charac- 
teristics identified in this report. In addition, few 



of tlie ideas have been pursued past the proposal 
stage. Therefore, these models do not appear 
defendable at this time for measurement 
applications. 

Several preview and nonlinear models have 
incorporated a few of tlie identified human 
operator characteristics; but the associated work 
was not pursued far enough to give particular 
credence to any one model as a, likely candidate 
for measurement applications. Very little work has 
been done with these two types of models. At this 
time, neither is considered suitable for measure- 
ment. 

In summary, none of the human operator 
models developed to date and reviewed in this 
study implement more than a few of the operator 
characteristics that have been identified. Those 
which have attempted to incorporate known or 
theorized information about the human are either 
based on associated assumptions which are un- 
acceptable for general measurement applications 
(as with the optimal control mode!) or were not 
far enough developed to suggest that they are 
desirable for use as a point of departure (as with 
discrete and finite state, adaptive, preview, and 
nonlinear models). Part of the problem appears to 
lie in the deficit of technology for dealing with 
such thing? as nonlinear analysis and discrete event 
modeling. The bulk of the problem, however, lies 
in the fact tliat existing models were not 
developed for measurement applications, and the 
attertipt has been one of emulating human output 
rather than simulating or otherwise accounting for 
the intricacies of human behavior. Therefore, 
underlying assumptions are not based upon charac- 
teristics of human behavior to the extent desired 
for measurement applications. 

V. REVIEW AND CONCLUSIONS 

A survey has been conducted of human 
operator modeling technques to assess their utility 
for performance measurement applications. 
Existing measurement techniques do not have the 
■capability to support the type of flight simulation 
research that entails accounting for the perception 
and utilization of cues. In addition, the many 
efforts to derive more suitable measures have 
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further complicated the problem by developing 
more and more different measures from which to, 
choose with little regard for the effects of an 
improper choice. They have also been somewhat 
misdirected in their emphasis on measures of 
system performance rather than measures of 
human behavior. A new measurement approach is 
required which minimizes the number of measures 
that must be considered, computed, and inter- 
preted; and which produces measures that 
characterize behavior succinctly and are sensitive 
to those aspects of human behavior that directly 
involve cue perception and utilization. It is 
believed that human operator modeling techniques 
may provide a basis for this type of measurement. 

Model validity is particularly important in the 
case of the envisioned measurement applications. 
A mode! used for measuring human performance 
should.be based on assumptions that are in full 
accord \yith the body of knowledge that exists 
about human behavior. Therefore, the first task of 
this study was to identify.the major human opera- 
tor characteristics that ought to be accounted for 
by a model to be used for measurement. These 
characteristics were later used in evaluating the 
various models for this application. i 

Existing ririodels were categorized by type as 
follows: (a) Describing Functions; (b) Optimal 
Control Modiels; (c) Discrete and Finite State 
Methods; (d)l Adaptive Techniques; (e) Preview 
Modds; and (Q Other Nonlinear Approaches. A 
survey was made of models in each categoiy by 
reviewing the literature and summarizing the 
various modeling studies. Particular attention was 
devoted to modeling assumptions and whether or 
not any specific human operator characteristics 
were incorporated. 
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Models in each category were evaluated based 
on the extent to which they represent the 
identified human operator characteristics as well as 
other aspects of their general validity for perform- 
ance measurement applications. It was found that 
none of the models reviewed im {dement more than 
a few of the operator characteristics; and those 
which do are either based on other assumptions 
which are unacceptable for measurement 
applications or have not been far enough 
developed to justify their use as a point of depar- 
ture. The major reason for this is that existing 
models were uoX developed with measurement as 
an objective; and the attempt has been to emulate 
human output rather than simulate or otherwise 
account for the intricacies of human behavior. 

It is concluded that existing human operator 
models arc not sufficiently representative of 
known characteristics of human behavior to be 
useful for gjeneral performance . measurement 
applications. It appears, too, that modeling studies 
of the past have emphasized matching the response 
of the average human operator at the expense of 
modeling the behavior of the individual, and for 
the particular application area of performance 
measurement, this is unacceptable. Studies are 
required to develop modeling techniques 
specifically for measurement uses, and tfiese ^ 
studies should be based on valid asisumptions 
about the human that are supported by the body 
of related knowledge that presently exists. Equally 
important, these studies should emphasize the 
development of models of the behavior . that 
generates the performance of the ihdividual rather 
than models of average operator performance 
output with little regard for the underlying 
behavior. 



3vt 

26 



REFERENCES 



Adams, J. A. Humaii tracking behavior. Psycho- 
logical BuUetitu 1 96 1 , 58( 1 ), 5 5 - 79 . 

Adams, J J; Synthesis of human response in 
closed -loop tracking tasks. Proceedings of the 
4th Annual NASA-University Conference on 
Manual Control, NASA SP192. 1968. 

Anderson, K. Some applications of optimal 
control theory 'to manual control. Proceedings 
of the 10th Annual Conference oh Manual 
Control Wright-Patterson AFB. Ohio. 1974. 

Angel. E. Adaptive finite-st^ile models of tlie 
human operator. Proceedings of the 3rd Annual 
NASA-University Conference on Manual 
Control NASA SP-144. 1967. ; 

Angel, E., & Bekey, G. Adaptive finite state 
models of manual control systems. IEEE Trans- 
actions on Man 'Machine Systems, 1968, 
MMS-9(1). 

Baron, S., & Kleinman, D. The human as an 
optimal controller and information processor. 
Proceedings of the 4th Annual NASA- 
University Conference on Manual Control 
1968, NASA SP-192. 

Baron, S., & Kleinman, D. Prediction and Analysis 
of Human PerformMice in a VTOL Hover Task. 
Proceedings of the 7th Annual Confetence on 
Manual Control, 1971, NASA SP.281. 

Baron, S., Kleinman, D., Miller, D., Levison, W., & 
Elkind, J. Application of optimal control 
theory to prediction of human performance in 
a complex task. Proceedings of the 5th Annual 
Conference on Manual Control, 1969, NASA 
SP.215. 

Baron, S., & Levison, W. An optimal control 
methodology for analyzing the effects of dis- 
play parameters on (performance and workload 
in manual flight control. IEEE Transactions on 
Systems, Man, and Cybernetics, 1975, SMC-5. 

Beare, A.C., & Kahn^'A.. Describing functions for 
comperiisatory tracking of sine waves plus noise. 
Proceedings of the 3rd Annual NASA- 
' University Conference on Manual -Control, 
1967, NASA SP-144. 



Bekey, G. The human operator as a sampled data 
system. IRE Transactions on Humm Factors in 
Electronics, 1962. 

Bekey, G., & Angel, E. Asynchronous finite state 
models of^ 'manual control systems. Proceedings 
of the 2nd Annual NASA- University Con- 
ference on Manual Control, 1966, NASA 
SP'128. 

Bekey, G., & Biddle, J. The effect of a random 
sampling interval on a sampled data model of 
the human opeutor. Proceedi^f^s of the 3rc^ 
Annual NASA-University tifiference on 
Manual Control 1967, NASA SP-144. 

Bekey, G., Meissinger, H., & Rose, R. Mathe- 
matical models of human operators in simple 
two-axis manual control systems."^ /£'£'£' Trans- 
actions on Human Factors in Electronics, 
1965,HFE-6(1). 

Bertcflson, P. Central intermittency twenty years 
later. Journal of Experimental Psychology, 
1966,18, 153-163. 

Briggs, G.E, Pursuit and compensatory modes of 
information display: A review, AMRI^TDR- 
62-93. AD-288 888. Wright-Pattersor, AFB, 
OH: Aerospace Medical Research Laboratory, 
1962. 

Broussard, J., & Stengel, R. Stability of the pilot- 
aircraft system in maneuvering flight.' 
Proceedings of the 12th Annual Conference on 
Manual Control 1976. NASA TM X-73, 170. 

Burgett, A.L. A Study of the Variability of Human 
Operator Performance Based on the Crossover 
Model. Proceedings of the 5th Annual Con- 
ference on Manual Control 1969. NASA 
SP-215. 

Burgin. G., & Walsh, M. Finite state machines as 
elements in control systems. Annual 
Symposium Record, IEEE Systems, Man, and 
Cybernetics Group, 1971, 

Costello, R.G. The surge model of the well-trained 
huiMan operator in simple manual control. 
IEEE Transactions on Man-Machine Systems, 
1968,MMS-9(1). 



3a. 

~27 



Costello, Ro, & Higgins, T. An inclusive classified 
bibliography pertaining to modeling th& human 
operator as an element in an automatic control 
system. IEEE Transaction on HFE, 1966, 
HFE-7(4). 

Craik, K.J.W. Theory of the human operator in 
control systems, I. The operator as an engineer- 
ing system. British Journal of Psychology, 
1947,38,56-^1. 

Creamer, L.R. Event uncertainty, psychological 
refractory period, and human data processing. 
Journal of Experimental Psychology, 1963, 
66(2), 187-194. . 

Davis, R. Expectancy and intermittency. Quarterly 
Journal of Experimental Psychology, 1965,17, 
75-78. 

Dey, D. The influence of a prediction display on 
the quasi-linear describing Unction and 
remnant measured with an adaptive analog-pilot 
in a closed loop. Proceedings of the 7th Annual 
Conference on Manual Control, 1971, NASA 
SP-281. • 

Diamantides, N. A pilot analog for airplane pitch 
control. Journal of Aeronautical Science, 1958, 
25, 361-370. (Cited in Pitkin, 1972.) 

Puggar, Ih.; Mannen, J., & Hannen, R. Pilot 
describing function models fdr nonlinear 
controlled elements. Proceedings of the 5th 
Annual Conference on Manual Control, 1969, 
NASASP-215. 

EUcind, J., KeUy, J., Payne, R. Adaptive charac- 
t^nstics of the humap. controller in systems 
having complex dynamicg. Proceedings of the 
5th National Symposium on Human Factors in 
Electronics, 1964. 

'Elkind, J., & MiOer, D. Process of adaptation by 
the human con ttpDer. Proceedings of the 2nd 
ArinuaL NASA-University. Conference on 
Manual Control, 1966, NASA SP.128. 

EDson, & Wheeler, L. The range Effect. 

USAF Technical Report No. 5813. Wright- 
Patterson AFB, OH: Air Materiel Command, 
1949. 

Fitts, P.M., & Posner, M.I. Human performance. 
' Belmont, CA: Brooks/Gole Publishing 
Company, 1969. 



Fleishman, E., & Rich, S. Role of kinesthetic and 
spatial/visual abilities in perceptual-motor learn- 
ing. Jourrialof Experimental Psychology, 1963, 
66, 6-11. 

Foget, L., & Moore, R. Modeling the human opera- 
tor with finite state machines. Proceedings of 
the 4th Annual NASA-Untversity Conference 
on Manual Control, 1968, NASA SP-192, (a) > 

Fogel, L., & Moore, R, Modeling the humari 
operator with finite state machines. NASA 
CR-1112, 1968. (b) 

Frost, G. Man-machine dynamics. In H. Van Cott 
& R. Kinkade (Eds.), Human Engineering Guide 
to Equipment Design. New York: McGraw-Hill, 
1972. 

Fuchs, A.H. The progression-regression hypothesis 
in Piefceptual-motor skill learning. Journal of 
Experimental Psychology, 1962i» 63(2), 
177-182. 

Gopher, D., & Wickens, C. Strategies and attention 
allocation in dual task performance. ARL- 
76-2/AFOSR-76-2. Washington, D.C.: Air 
Force Office of Scientific Research, 1975. (a) 

Gopher, D., & Wickens* C. Tracking performance 
under time sharing conditions with a digit 
processing task: A feedback control theory 
analysis. Proceedings of the 11th Annual 
Conference, on Mdnual Control, 1975, NASA 
TM'X.62,464. (b) 

Gould, E., & Fu, K. Adaptive model of the human 
operator in a time-varying oontroi task. 
Proceedings of the 2nd Annual 
NASA-University Conference on Manual 
Control, 1966, NASA SP-128. 

Harvey, T., & Dillow, J. Fly and fight: Predicting 
piloted performance in air-to-air combat. 
Proceedings of the 10th Annual Conference on 
Manual Control, 1974, Wright-Patterson AFB, 
Ohio. 

Hick, W. Discontinuous functioning of the human 
operator in pursuit tasks. Quarterly Journal of 
Experimental Psychology, 1948, 1, 36-51. 
(QtcdinBertelson, 1966.) . 

Jackson, G.A. Measuring human perfohnance with 
a parameter tracking version of the crossover 
.^modei NASACR-910, 1967. 



Jacksori, K.F. Behavior in controlling a combina- 
tion of systems. Ergonomics ^ 1958, 2, 52 --6 2. 

Jagacinski, R., Burke, M., 8l Miller, D. TT«e use of 
schemata and acceleration information in stop- 
ping a pendulum-like system. Proceedings of 
the 12th Annual Conference on Manual 
Control 1976, NASA TM X-73,170. 

Johannsen, G, Development and optimization of a 
nonlinear multiparameter human operator 
model. IEEE Transactions on Systems, Man, 
atul Cy^bemetics, 1972, SIVlC-2(4). 

Junker, A.M., 8l Price, D. Comparison between a 
peripheral display and motion information on 
human tracking about the roll ^s.J*roceedings 
of the 12th Annual Conference on Manual 
Control 1976, NASA TM X-73.170. 

Kelley, C.R. Manual and automatic control. New 
York: John Wiley & Sons, 1968. (a) . ' 

Kelley,C.R. Human operator models for manual 
control. In G.W. Levy (Ed.), Symposium on 
Applied Models of Man-Machine Systems 

^ Performance. Columbus, OH: North American 
Rockwell, 1968. (b) 

Kleinman,'D., 8l Baron, S. Analytic evaluation of 
display requirements for approach to landing. 
NASACR-1952, 1971. 

Kleinman, D., Baron, S., 8l Levison, W. An 
Optimal Control Model of Human Behavior. 
Proceedings of the 5th Annual Co- ference on 
Manual Control 1 969, NASA SP-2 1 

Kleinman, D., 8l Phatak, A. Curren Status of 
Models for the Human Opemtrir As a Controller 
and Decision Maker in Manned Aerospace 
Systems. Procecdirig^ of the 1972 IEEE Con- 
ference on Decision and Control 1972. 

knoop, D., & Fu, K. An adaptive model of the 
human operator in a control system. Proceed- 
ings of the 5th National Symposium on Human 
Facto rs in Electron /rs , 1 9 64 . 

Levison, W. A model for task interference. 
l^)ceedings of the 6th Annual Conference on 
Manual Control 1970, Wriglit -Patterson AFB, 
Ohio. 

Levfeon, W. A control theory modef for human 
decision making. Annual Symposium Record, 
IEEE Systems, Man, and Cybernetics Group, 
1971. 



Levison, W.H., & Etkind, J,L Two-dimensional 
manual control systems with separate displays. 
Proceedings of the 3rd Anniml NASA^ 
University Conference on Manual Control, 
1967, NASA SP'144. 

Levison, W,H., 8l Kleinman, D.L. A model for 
human controller remnant. Proceedings of the 
4th Anmml NASA-University Conference on 
Manual Control 1968, NASA SP-19X 

McRuer, D., & .Jex, H. A review of quasi-linear 
pilot models. IEEE Transactions on Human 
Factors in Electronics, 1967, HFE-8(3). 

McRuer, D., & Krendel, E.S. Dynamic response of 
human operators, WADC-TR-56-524, AD-110 
693. Wright-Patterson AFB, OH: Wright Air 
Development Center, Air Research and 
Development Command, 1957. 

McRuer, D.T., & Krendel, E.S. A review and sum- 
mary of tracking research applied to the 
description of human dynamic response. 
Institute of Radio Engineers (IRE) WESCON 
Convention Record, Part 4, 254-262, 1958. 

McRuer, D.T,, & Krendel, E.S. Mathematical 
models of human pilot: behavior. AGARDo- 
graph No. 188, AGARD-AG-1 88, 1974. 

Merritt, M, The application of discrete inodeling 
elements to the synthesis and identification of a ^ 
deterministic model for the visual scanning 
behavior of human operators. Proceedings of 
the 4th Annual NASA-University Conference 
on Manual Control 1968, NASA SP-192. 

Merritt, M., & Bekey, G. An asynchronous pulse- 
amplitude pulse-width model of the human 
operator. Proceedings of the 3rd Annual 
NASA-University Conference on Manual 
Control 1967, NASA SP-144. 

Miller, D. The Effects of Performance — Scoring 
Criteria on Compensatory Tracking Behavior. 
IEEE Transactions on Human Factors in 
Electronics, 1965, HFE-6(1). - 

Miller, D., & Elkind, J. The adaptive response of 
the human conttoUer to changes in controlled 
process dynamics. IEEE TYansactions on 
Human Factors in Electronics, 1967, HFE-8(3). 



. ' I 



29 



Moriarty, T. Manual control of a time-varying 
vehicle. Proceedings of the lOth Annual Con- 
ference on Manual Control, 1974, Wri^t- 
Patterson AFB, Ohio. 

Myers, J.L. Fundamentals of experimental design, 
Boston: Allyn & Bacon, Inc., 179-182, 1972. 

Navas, F. Sampling or quantization in the human 
tracking system, (MS Thesis, Massachusetts 
institute of Technology) Cambridge, 
Massachusetts, 1963. 

Newell, FJD. Inflight and ground simulation 
measurements of pilot transfer characteristics in 
the compensatory roll tracking task. Proceed- 
ings of the 3rd Annual NASA-University 
Conference on Manuel Control, 1967, NASA 
SP-144. 

Niemela, R. Detection of a change in plant , 
dynamics in a man-machine system. Proceed- 
ings of the 10th Annual Conference on Manual 
Control 1974, Wright-Patterson AFB, Ohio. 

Obermayer, R., 8t Muckler, F. Modem control 
system theory and huihan control functions. 
Proceedings of the 5th National Symposium on 
Human Factors in Electronics, IEEE, 1964. 

Obeimayer, R., & Muckler, F. On the inverse 
optimal control problem in ^manual control 
systems. NASACR-208, 1965. 

Obennayer, R., Swartz, W., & Mudcler, F. Inter- 
action of information displays 1 with control 
system dynamics^ and course frequency in 
continuous tracking. Perceptual md Motor 
Skills, 1962, Vol. IS, Monograph Supplement 
2-V15, Southern Universities Press, 199-215. 

Obennayer, R., Webster, R., & Muckler, F. Studies 
in optimal behavior in manual control systems: 

' The effect of four performance criteria in 
compensatory rate-control tracking. Proceed- 
ings of the 2nd Annual NASA-University 
Conference on Manual Control, 1966, NASA 
SP-128. 

Pew, R. Performance of human operators in a 
three-state relay control system with velocity - 
augmi^ted displays. IEEE TYansactions on 
Human Factors in Electronics, 1966, HFE-7(2). 

Pew, R., & Rupp, G. Two quantitative measures^ of 
skill development. Journal of Expmmental_ 



/ . ■ 

Phatak, A., 8c Bekey, G. Model of the adaptive 
behavior of tlie human operator in response to 
a sudden change in the control situation. 
Proceedings of th^ 4th Annual NASA- 
Un iversity Conference on Manual Control, 
1968, NASA SP-192. 

T'hatak, A., & Bekey, G. I>ecision processes in the 
adaptive behavior of human controllers. 
Proceedings of the 5th Annual Conference on 
Manual Control, 1969, NASA SP-21 s: 

Phatak, A., & Kessler, K. Evaluation of optimal 
control type models for the human gunner in 
an anti-aircraft artillery (AAA) system. 
Proceedings of the 11th Annual Conference on 
Manual Control, 1975, NASA TM X-62,464. 

Phatak, A., Weinert, H., Segall, I., & Day, C 
Identification of a modifled optimal control 
model for the human operator. Automatica, 
1976, '12, 31-41. (Pergamcm Press, Great 
Britain) 

Phatak, A.V., & Weir, D.H. On the dynamic 
response of the human operator to transieiit 
inputs. Proceedings of the 4th Annual NASA- 
University Conference on Manual Control, 
1968, NASASP-192. 

Pitkin, E. A Non-Linear Feedback Model for 
Tracking Studies. Proceedings of the . 8th 
Annual Conference on Manual Control, 1972, 
Wright-Patterson AFB, Ohio. 

Poulton, E.G. Perceptual anticipation and reaction 
, time. Quarterly Journal of Experimental 
Psychohgy, 1950, Vol II, Part 3, 99-1 12. ' 

Poulton, E.G. On sim(4e methods of scoring.track- 
ing error. Psychological Bulletin, 1962, 59(4), 
320-328. 

Poulton, E. A Quantal Model for Human Tracking. 
Proceedings of the 3rd Annual NASA- 
University Conference on Manual Control, 
1967, NASA SP-144. 

Poulton, E.G. Ttadcing skill and manual control. 
New York: Acaderhic Press, 1974. 

Prcyas, A. A theory and model of human learning 
behavbr in a manual control task. NASA 
GR-1124, 1968. 

Reid, L. An investigation into pujsuitjracking in - 
the-presence-xif x'disturbance signal. Proceed- 
ings of the 5th Annual Conference on Manual 
Control^ 1969, NASA SP-21 5- 



Reid, L.D., & Drewell, N.H. A pilot model for 
tracking with preview. Proceedings of the St It 
Annual Conference on Manual Control, 1972, 
Wright-Patterson AFB, Ohio. 

Ringland, R.F., &, Stapleford, R.L. Motion cue 
effects on pilot tracking. l^)ceedingsofthc 7th 

. Annual Conference on Manual Control, 1971, 
NASASP-281. 

Ringland, R.F., & Stapleford, R.L. Pilot describing 
function measurements for combined visual and 
linear acceleration cues. Proceedings of the 8th 
Annual Conference on Manual Control, 1972, 
Wright-Patterson AFB, Ohio. 

Salmon, E.P., 8l Gallagher, J.T. Identification of 
pilot dynamics with and without motion cues. 
Proceedings of the 6th Annual Conference on 
Manual Control, 1970, Wright-Patterson AFB, 
Ohio. 0 

Scarie, L.V., & Taylor, F.V. Studies of tracking 
behavior. I. Rate and time characteristics of 
simple corrective movements. Journal of 
Experimental Psychology , 1948, 38(5), 
615-631. 

Sheridan, T. Three models of preview control. 
IE HE Transactions on Human Factors in 
Electronics, 1966, HFE.7(2). 

Sheridan, T.B., Fabis, B.F., & Roland, R.D. Pre- 
view control behavior and optimal control 
norms. Proceedings of the 2nd Annual Con- 
ference on Manual Control, 1966, NASA 
SP-128: 

Sheridan, T.B., 8l Ferrefl, W.R. Man-Machine 
sys/ems. Cambridge, MA: 1974. 

Sheridan, T., Johnson, W., Bell, A., & Kreifeldt, J. 

Conttul models of creatures which look ahead. 
Proceedings of the 5th National Symposium on 
Human Factors in Electronics, 1964. 

Shirley, R.S., 8l Young, L.R. Motion cues in man- 
vehicle, control. Proceedings of the 4th Annual 
Nasa-University Conference on Manual Control^ 
1968, NASA SP-192. (a) 

Shirley, R.S., & Young, L.R. Motion cues in man- 
vehicle control. IEEE Ttansactions on Mna- 
Machine Systems, 196ff; MMS-9(4;. (b)^ 

Snuthy H. Hiimah describing functions measured in 
fli^t and on simulators. IEEE Transactions on 
"Human Factors in Electronics, 1967, HFE-8(8). 



Smith, M.C. Theories of the Psychological 
Refractory Period, Psychological Bulletin, 
1967, 67(3), 202-213. 

Stapleford, R., Peters, R., &. Alex, ? .Experiments 
and a model for pilot dynamics with visual and 
motion inputs. NASACR1325, 1969. 

Stengel, R. Personal communication, 1976. 

Summers, L.G., & Z\edmBn,K, A study of manual 
control methodology with annot<.!cd biblio- 
graphy. NASA CRA25,A964. 

Taylor, F., & Birmingham, H.P. Studies of tracking 
behavior. H. The acceleration pattern of quick 
manual corrective responses. Quarterly Journal 
of Experimental Psychology, 1948, 28, 
783-795. 

Taylor, F.V., & Birmingham, H.P. That con- 
founded system perfonnance measure — A 
demonstration. Psychological Review, 1959, 
66(3). 178-182. 

Telford, C. The refractory phase of ^'oluntary and 
associative responses. Journal of Experimental 
Psychology, 1931, 14, 1-35. (Cited in 
Bertelson, 1966.) 

Thomas, R., &. Tou, J. Human decision making in 
manual control systems. Proceedings of the , 2nd 
Annual NASA-University Conference on 
Manual Control, 1966, NASA SP-128. 

Todosiev, E.P., Rose, R.E., & Summers, L.G. 
Human performance in single and two-axis 
tracking systems. Proceedings of the 2nd 
Annual NASA'University Conference on 
Manual Control, \966,NAS A SFA2S. 

Todosiev, E.P., Rose, R.E., &. Summers, L.G. 
Human performance in single — and two-axis . 
tracking systems. IEEE Transactions on Human 
Factors in Electronics, 1967, HFE-8(2). 

Veldhuyzen, W., Van Lunteren, A,, &. Stassen, H. 
Modeling the helmsman of a supertanker: Some 
preliminary experiments. Proceedings of the 
8th Annual Conference on Manual Control, 
1972, Wright-Patterson AFB, Ohio. 

Vince, M.A. Corrective movements in a pursuit 
task. Quarterly Journal vf -Experimental 
Psycfioldgy, 1948, i; 85-103. (a) 

Vince, M.A, The intermittency of control move- 
ments and the psychological refractory period. 
British Journal of Psychology, 1948, 38, 
149-157. (b) 



Vince, M.A. Some exceptions to the psychological 
refracti^ry period in unskilled manual responses. 
Medical Research Council, APU 124/50, 1950. 

Vinje, E.W. Human operator dynamics for aural 
compensatory {ruMng. Proceedings of the 7th 
Annual Conference on Manual Control, 1971, 
NASASP.281. 

Walston, C.E., & Wanen, C.E. Amlysis of the 
human operator in a closed-loop system, 
HRRC-RB-53-32. Lackland AFB; TX: Air 
Research and Development Command, 1953. 

Weir, D., & Phatak, A. Model of human operator 
response lo step transitions in controlled 
clement dynamics. Proceedings of the 2nd 
Annual NASA-University Conference on 
Manual Control, 1966, NASA SP-128. 

Welford, A. The "psychological refractory period" 
and the timing of higli speed performance - A 
review and a tlieory. British Journal of Psycho- 
logy. 1952, 43, 2-19. (Cited in Bertelson, 
1966.) 

Welford, A. The measurement of sensory-motor 
performance. Survey and reappraisal of twelve 
years' progress. I:rgononiics, 1960, 3, 189-229. 

Wewerinke, P. Human operator workload for 
various control siiu^iiion^. Proceedings of the 
10th Annual Conference on Manual Control,- 
1974, Wright-Patterson AFB, Ohio. 



Wherry, R. The development of sophisticated 
models of man-machine system performance. In 
G. Levy (Ed.), Symposium on Applied Models 
of Man-Machine Systems Performance. North 
American Aviation Report NR69H-591 , 2-1 to 
2-37. (AD^97 939)., 

Wickens, CD. The effect of time slwring on the 
ixrformance of information processing tasks: A 
feedback control analysis. Human Performance 
Center Technical Report No. 51. Ann Arbor, 
Ml: University of Michigan, 1974, ' 

\. 

Wickens, CD. The effects of divided attention on 
information processing In manual tracking. 
Journal of Experimental Psychology: Human 
Perception and Performance, 1976, 2(1), 1-13. 

Wierenga, R. An evaluation of a pilot model based 
on kalman filtering and optimal control. 
Proceedings of the 5th Annual Conference on 
Mamial Control. 1969, NASA SP-215, 

Young, L., & dinsdale, P. Contributions of roll 
and yaw motion cues in manual control. 
Proceedings of the 5th Annual Conference on 
Manual Control. 1969, NASA SP-215, 

Young, L.R. & Stark, L, Biological control 
systems - A critical review and evaluation: 
Developments in manual oohtroi NASA 
CR-190, 1965. 



BIBLIOC.RAHIY 



Adams, J. A closed-loop theory of motor learning. 
Ji/urnal of Motor Behavior, 1971, 3(2), 
111-149. 

Adams, J., & Goode, M. Application of human 
transfer functions to system analyses. NASA- 
TN-D.5478, 1969. 

Adams, J., & Webber, C. Monte Carlo model of 
tracking behavior. Human F'actors Journal, 
• 1963,5,81-102. 

Allen, R., & Jex, H. A simple fourier analysis 
technique for measuring the dynamic response 
of manual conUoi systems. Proceedings of the 
6th Annual Conference on Manual Control, 
1970, Wright-Patterson AFB, Ohio. 

Armstrong, T. Training for the Production of 
Memorized Mo ye merit Patterns. Proceedings of 
the 6th Annual Conference on Manual Control, 
1970, Wright-Patterson AFB, Ohio. 

Baty, D. Effects of display gain on human opera- 
tor information processing rate in a rate control 
tracking task. Proceedings of the 5th Annual 
Conference on Manual Control 1969, NASA 
SP-215.. 

Baty, D. Human transinformation rates during 
one-to-four axis tracking with a concurrent 
audio-task. Proceedings of the 7th Annual 
Conference on Manuat Control 1971, NASA 
SP-281. 

Bckey, G. Description of the human operator in 
control systems, InC. Leondes (Ed.), Modern 
control systems theory. New York: >IcGraw- 
Hall, 1965,431-462. 

Bliss, J. Human operator describing functions with 
visual and tactile displays, Proceedings of the 
3rd Annual NASA -University Conference on 
Manual Control \961^:ti^S A S?-\^. 

Briggs, C., Co^ff, R, Accomplishments in 
human operator simulation, Columbus, OH: 
Ohio State. University Research Foundation, 
Department of Electrical Engineering, 1960. 

Briggs, P., & Hofmann, L*. The application of 
human operator describing function theory to 
the prediction of tracking performance in the 
Cheyenne swiveling gunner's station. Proceed- 
ings of the 6th Annual Conference on Manual 
Control 1970, Wright-Patterson AFB, Ohio. 



Chase, W. Liffect of color on pilot performance 
and transfer functions using a full-spectrum, 
calligraphic, color di splay -system. Proceedings 
of A! A A Visual atul Motion Simulation Con- 
ference, 1976, Dayton, Ohio. 

Cliff, R. Tlie effects of attention sharing in a 
dynamic dual-task environment. Proceedings of 
the 7th Annual Conference on Manual Control, 
1971, NASA SP-2 18. 

Cliff, R. A single channel model of attention 
sharing in a dynamic, dual-task environment. 
Proceedings of the 8th Annual Conference on 
Manual Control 1972, Wriglit-Patter^on AFB, 
Ohio. 

Craik, K. Theory of the human operator in control 
systems. II. Man as an element in a control 
. system. British Journal of I'sychology, .1948, 
38,142-148. - 

Crossman, E, The information capacity of the 
human motor system in pursuit tracking. 
. . Quarterly Journal of Experimental Psycfiology, 
1960, XIKPart 1), 1-16. 

Crossman, E. Discussion of Paper 9: A, model for 
human controller remnant by Levison, Baron, 
and Klein man. Proceedings of the 5 th Annual 
Conference (^n Manual Control 1969, NASA 
SP.215. 

Crossman^ E., & Delp, H. Application of Gabor^s 
elementary signal theorem to estimation of 
nonstationary human spectral response. 
Proceedings of the 5th Annual Conference on 
Manual Control 1969, NASA SP-215. 

Crothere, E. General Markov models for learning 
with intertrial forgetting. TR-53. Institute for 
Mathematical Studies in the SociaF Sciences, 
Applied Mathematics and Statistics Laboratory, 
Stanford University, Stanford, Connecticut, 
1963. 

Curry, R. A* Bayesian model for visual space 
perception. Proceedings of the 7th Annual 
Conference on Manual Control 1971, NASA 
SP-281. 

' Dukes, T., & Sun, P. A performance measure for 
manual control systems. Proceedings of the 7th 
Annual Conference on Manual Control 1971, 
NASA SP-281. 



Elkifid, J., & Green, D. Measurement of time- 
varying and nonlinear dynamic characteristics 
of human pilots. ASD-TR.61-225. Wright- 
Patterson AFB, OH : Aeronautical Systems 
Division, Air Force Systems Command, 1961. 

Elkifid, J., & Miller, D. Adaptive characteristics of 
the human controller of time varying systems, 
AFFDL-TR-66-60. WriglU-Patterson AFB, OH: 
Air Force Flight Dynamics Laboratory, 1967. 

Fa I b , P. , & Kovat ch , G. Dynamical system 
m(xleling' hf human operators - a preliminary 
report, NASA SP-128, 1966. 

Ferrell, W., & Cohen, H. Prediction and Decision 
Making in Manual Control. Proceedings of the 
4th Annual NASA-Universiiy Conference on 
Manual Control, 1968. NASA SP- 192. 

Fukushima, K., Kawabata, K.,& Seki, Y. Adaptive 
properties of human operators in^ closed loop 
man-machine systems. In J. Rose (Ed.), 
Advances in cybernetics and systems (yo\. 1). 
London: Gordon & Breach Science Publication, 
1974. 

Gabel, R., & Roberts, R. Signals and lineiJr systems. 
New York: John Wiley & Sons, 1973. 

Gaiiner, P. Measured information ^ capacity as a 
performance index in manual tracking tasks. 
NASA SP- 128, 1966. 

Garyey, W. A comparison of the effects of training 
and secondary tasks on tracking behavior. 
Journal of Applied Psychology, 1960, 44(6), 
370-375. , 

Garvey, W., & Mitnick, L. An analysis of tracking 
behavior in terms of lead-lag errors. Journal of 
Experimental Psychology, 1957, 53(6), 
372-378. 

Gibbss C. State of the-art in developing nnodels of 
skilled movement. Proceedings of the 3rd 
Annual NASA-University Conference on 
Manual Control, 1967, NASA SP-144. 

Gilstad, D., & Fu, K, A two dimensional pattern 
recognizing, adaptive model of a human 
controller. Proceedings of the 6th Annual 
Conference on Manual Control, 1970, Wright- 
Patterson AFB, Ohio. 



Gordon-Smith, M. An investigation into some 
aspects of tlie human operator describing 
function whOe controlling a single degree of 
(reedotn. Proceedings of the 5th Anrtual 
Conference on Manual Control; 1969, NASA 
SP-215. 

Graham, D., & IV^ uer, D. Analysis of nonlinear 
control systCfW^^ov^ York: Dover Publications 
Inc., 1961. 

s Gregg, L. A digitaT* computer technique for 
operator performance studies. Proceedings of 
Fifth National Symposi n on Human Factors 
in F.lectronics; IEEE, 1964. 

Hess, R. Analytical display design for flight tasks 
conducted under instrument meteological 
^ conditions. IEEE Transactions on Systems, 
Man, and Cybernetics', 1977, SMC^7(6). 

Hess, R., & Teichgraber, W. Error quantization 
effects in compensatory tracking taisk^. IEEE 
Transactions on Systems, Man, and Cyber- 
netics. 1974, SMC-4. 

Jex, H. Modeling man-machine control systems in 
biodynamic environments. Annual Symposium 
Record, IEEE Systems, Man, and Cybernetics 
Group, 1971.' 

I' 

Jex, H., McDonnell, J., & Phatak, A. A "critical" 
tracking task for manual control research. IEEE 
Transactions on Human Factors in Electronics, 
1966,HFE-7(4). 

Jex, H., McDonnell, J., &JPhatak, A. A "critical" 
tracking task for man-njachine research related 
to operator's effective ilelay time. Proceedings 
of the 2nd Annual NASA-University Con- 
ference on Manual Control, 1966, NASA 
SP-128. ' - - - 

Johnston, D., & Magdaleno, R. Pilot-vehicle 
describing function measures in high, lateral- 
longiitudinal coupled flight. Proceedings of t.he 
10th Annual Conference on Manual Control, 
1974, Wright-Patterson AFB, Ohio. 

Jones, W. Is proprioception important for skilled 
pQTfoTitx^ncelJoumal of Motor Beljiivior, 1974, 
6(0,33-45. 



Kaplan. K., & Sklansky. J. Afm/y:iis of Miirkov 
chain nu nlcls < > ] adaptive pn > i esses. AN! R L-T R- 
f>5-3. Wright-Pattcrson AIB. Oil: Aciospace 
Medical Research Laboratory, P^o5. 

Kelley, C. Design applications of adaptive (sell* 
adjusting) simulators, f^occcdinys of the 2nd 
An final /\A SA 'Lfnivcrsyy Cofifercnee on 
Manual Control 1966, NASA-SP-12H, 

Kelley, C. A psychological approacl- to operator n./ 
modeling in nianuul conUo\. Proeecdin^sof the 
3hl Annual NASA-University Confercncv on 
Manual Control. 1967. NASA SP-144. 

Kelley, C. Display layout. In R. Bernotat. & K, 
Ciartncr <lids.). Displays and controls. 
Anisterdani: Swcts anil Zeitlinger N.V.. 1972. 

Krniss. K. Can proprioceptive cues unload the 
human operator'.* f^oceedins:s of the 6th 
. Vmual Conference on Manual Contn)l, 1970. 
Wright-Patterson Al B. Ohio. 

KrendeL E., & Bloom, J. The natural pilot model 
for Jlij^ht fyroficieney evaluation, NTDC .^23-1. 
Port Washington. New York. 1963. 

Krendel, E., & MeRuer, D. Psychological and 
physiological skill devcloment a control 
engineering model. Proceeding of. the 4th 
Annual N AS A - University Conference on 
Manual Controi 1968. NASA SP- 192. 

Kreifeldt, J. A sampled-data pursuit tracking 
model, l!\i.l\ Transactions <ni Human Factors in 
Electronics. 1965, HFE-6(1)-. , 

Kugel, D. Determination of in-flight pilot para- 
meiers using a Nowton-Raphson minimization^ 
tech niq UQ^I^acecd s o f th(r i(Jtli Annual 
Confercncv on Ma ! Control, ^ 1974, Wriglit- 
Patterson AFB, Ohio. 

Lcvispn, W. Two dimensional manual control 

systems. Proceedings of the 2nd Annual 

NASA-University Conference on Manual 
Controi 1966. NASA SP-1 28. 

Levison, W.., Baron, S., & Junker A. Modeling the 
effects of environmental factors on human - 
control and information processhig. AMRL-TR- 
76-74. Wright -Patters on AFB. OH: Aerospace 
Medical Research Laboratory, 1976. 



Levison, W,, Baron', S., & Kleinman'o. A model 
for human controller reginant. Proceedings of 
the 5fh Annual Conference on Manual Control, * 
1969, NASASP-2I5. 

Levy, G. Criteria for selection and application of 
models. In G, Levy (Ed.). SymfXisiwn^n 
Apf)lk'd Models of Man -Machine Systems. (Nr 
694-591, AD-697 939). Columbus, OH; North 
American Rockwell, 1969. 

Magdaleno, R., Jex, H., & Johnson, W. Tracking 
quasi-predictable displays subjective 'predict- 
ability gradations, pilot riiodels for periodic and 
narrowband inputs. Proceedings of fhe 5th 
Annual Conference on Manual Control, 1969, 
NASA SP-215. 

McLeod, P, Response strategics,^ with a cross- 
coupled control system, f^oceedings of the 8th 
Annual Conference on Manual Control, 1972. 
Wright-Patterson AFB, Ohio. 

McRuer, D. Lectures on theory of manual-vehicle 
coritrol. In R; Bernotat & K. Garlner,.{Eds.), 
Displays and controls. Amsterdam: Swets and 
Zeitlinger N.V.,. 1972. 

McRuer, D., ^& Weir, D. Theory of manual 
vehicular control. Ergonomics, 1969, 12(4), 
599-633. 

McRuer, D., Hofmann, L., Jex, H., Moore, G., 
Phatak, A., Weir, D., & Wolkovitch, J. New 

approaches to human -pi lot /vehicle dynamic 
analysis. AFFDI^TR-67-1 50. Wright-Patterson-. 
AFB, OH: Air Force Flight Dynamics Labora- 
tory, 1 96R. 

Meiry, J. Stochastic modeling of human learning 
behavior, f^ocoedihgs of the 4th Annual 
NASA'Uni versity Co nference on Manual 
Control 1968, NASA SP-1 92. 

Mekel, R. Design of corrective dynamics 
coritrolJers. Proceedings of the ^th Annual 
Conference on Manual Control^ 1970, Wright- 
Patterson AFB. Ohio. 

Miller, D. Human performance in time-optimal 
state regulation tasks. Proceedings of the 5th 
Annual Conference on Manual Control 1969, 
NASA SP-215. • 



39 

35 



Noble, IV^., Fitts, P., & Warren, C. Tfw frequency 
response ofskillvd subjects in a pursuit traekins^ 
task. AFPTRC-TN.5542. Lackland AFB, TX: 
Air Force Personnel & Training Researclv 
Center, November 1955. 

» 

Onstott, E. Multi-Axis pilotwchicle dynamics. 
f^>ceeJin^s of the lOth Annual Conference on 
Manual Control, 1974, Wright-Patterson AlMi, 
Ohio. 

Onstott, E. Task interference in i^ulti-axis aircraft 
stabilization, f^oceedings of the 12th Annual 
Conference on Manual ControU 1976. NASA 

; iW X'13,\70. University of Illinois, 
Champaign, Illinois. 

Paskin, H. A discrete stochastic optimal control 
model of the human operator. Proceedings of 

' the 6ih Annual Conference on Manual Control, 
1^70, Wright-Patterson AFB, Ohio. 

Pew, R. Acquisition of hierarchical control over 
tjie temporal organization of a skill, Journal of 
Kxpcrinientdt Psychology, 1966, 71(5), 
764 -771. 

Pew, R. flunian perceptual - motor performance. 
TR48, AD-A0I2 097. University of Michigan, 
Departn]ent of Psychology, Human Perform- 
ance Center, 1974. 

Pew, R., '^uffendack, J., & Fensch, L. Summary of 
sine-^nv^e tracking studies. Proceedings of the 
2nd Anhual NASA-University Conference on 
Manual Control 1966, NASA SP-128. - - - 

?ew, R., Duffendack, J., & Frensch, L. Sine-wave 
tracking revisited. IEEE Transactions on 
Human Factors itt Electronics, 1967, HFE-8(2). 

Phatak, A., & Kleinman, D. Current status of 
models for the human operator as a controller 
and decision maker in manned aerospace 
systems. Conference Proceedings No. 114 on 
Automation in Manned Aerospace Systems, 
1972, NATO AGARD Avionics Panel XXIV 
Meeting, Dayton, Ohio. 

Phatak, A., Mehra, R,, & Day, C. Application of 
system identification to modeling the human 
controller under stress conditions. IEEE Trans- 

* ^ actions on /i utomatic Control, 1 975 . 



Pitkin, E., & Vinje, E^ Evaluation ofhuman opera- 
tor aural*' and visual displays with tJie critical 
tracking tiisk. lyocccdings of the Sth Annual 
'Conference on Manual Control. 1972, Wright- 

- Patterson AFB, Ohio. 

Platzer, H. The phi-se plane as a tool for the study 
of huniwi behavior iii tracking problems. 
WADC-TR-55444. Wright-Patterson AFB, OH: 
Aerospace Medical Research Laboratory, 1955. 

Preyss, A., & Meiry, J, Stochastic modeling of 
human learning behavior. Proceedings of the 
3rd Annual NASA-University Conference on 
Manual Control, 1967, NASA SP.I44. 

Reid, L. The design of a facility for the n:easure- 
nient of human pilot dynamics. UTIAS JN-95, 
Toronto, Canada: Institute for Aerospace 
Studies, University of Toronto, 1965. 

Wy^ck, B,, & Krendel, E. Experimental study of 
I ' natural pilot flight proficiency evaluation 
nwd^i. NAVTRADEVCEN 323-2. Orlando, 
TL: Njval Training Devices Center, 1963. 

Sviiwciz ^. Some contributions to the theory of 
]\nt iiiodels describing the control behavior of 
the lujman operator In R. Bemotat & K. 
Gartner (Eds.), Displays and wntrols. 
Aiqsterdam: Swets and Zeitlinger N. V., 1972. 

Senders, J. Hitman tracking behavior. Minneapolis 
Honeywell Aerospace Docum^t U-ED 6141. 
Minneapolis, MN: Minneapolis Honeywell 
Regulator Company, Aeronautical Division, 
1959."" 

Sheridan, T. Time -variable dynamics of human 
operator systems. AFCRC-TN-60, 169. 
Cambridge, MA: Air Force Cambridge Research 
Center, I960. « ' 

Sheridan, T. Studies of adaptive characteristics of 
the human controller, ESD-TDR-62-35 1 . 
Hanscom Field,' Bedford, MA: Electronic 
Systems Division, Air Force Systems Com- 
mand, 1962. 

r 

Shinners, S. Techniques of system engineering. 
New York: McGraw-Hill, 1967. 



Sliinners, S. Modeling ol'lmnuin opcriitor pcrfomi- 
ance utili/ing time series analysis, li'.hh' Trans- 
actums on Systcffis, Man, and Cyhcrnctics. 
^ 1974, StVIC-4(5). 

Shiiiners, S., & Berger, C. Invcsii^afion nnd idcnti- 
Jicatitni of human operator ^^pvrj'on nance 
models usifi^ (he theory oj' time series analysis. 
AMRL'TR-72-88. Wright^Patterson Al-B, Oil: 
Acrospjcv Mcdieal Research Laboratory, 1^)73. 

Shirley, R. A cuiiiparisoii of tecliniqiies for 
nieasurin|» Iniiuaii operator frequency response. 
i'roccedini^s of the 6th Annual Conference on 
Manual Contnd, 1070, Wright-Patlerson Al-B. 
Ohio. 

Sniallwood, R. internal models and the luinian 
instrunieiit monitor. //•7:7f 'lYansactions on 
^ Human Factors in Idectronies, .1961 , HFE-8(3). 

Smith, H. Hainan descrit^ing runctions measured in 
llight and on sinuilators. I^'ocecxlini^s of the 2nd 
Annual \ASA'L'niversity Conference on 
Manual Omtroi 1066, NASASP-12R. 

Spain, D. lilentincalion and n.iodeling of discrete 
stochastic linear systems, /^roceedinf^s of /Id:/-: 
Conference on Decision and Control, 1972. 

Stapleford, R. Multiniodaiity pilot model for 
visual and nu)tion cues. l^oeeedin}\s of the 4th 
Annual NASA-University Conference on 
Manual Control 1968. NASASM92. 

Stapleford, R., McRuer, D,,& Magdaleno, R. Pilot 
describing function measurements in a multi- 
loop task. /Proceedings of the 2nd' Annual 
i\'ASA'University Conference on Manual 
. Gwn>/. 1966, NASA SP. 128. 

Sun, P. Experimental evaluation of a display para- 
meter using the phase margin performance 
measure. /Proceedings of the Sth Annual Con- 
ference on Manual Control, 1972, Wright- 
Patterson AFB, Ohio. 

Swisher, C. A review of human operator models 
Mith applications to tracking under ci}viron- 
mental stress. AM R L,>TR-7248. Wright- 
Patterson AFB, OH: Aerospace Medical 
Research Laboratory, 1973. 



Tanaka, K., Goto, N., & VVashizu, K A comparison 
ol techniques lor identifying hunian operator 
dynamics utilizing time series analysis. /WmA 
ings of the I2th Annual Conference on Manual 
Omtrol, 1976, NASA TM X-73, 1 70, University 
'.)f Illinois, Champaign. Illinois. 

Taylor, L Discussion of spectral human-response 
' analysis. Proceedings of the 2nd Annual 

NASA-University Conference on Manual 

Control 1966, NASA SP- 128. 

Taylor, L. A comparison of humaii response 
modeling in the time and frequency domains. 
Proceedings of the 3rd Annual NASA- 
University Conference on Manual Control, 

1967, NASASP-144. 

Taylor, L, Nonlinear time-domain models of 
human controllers. Proceedings of the 5th 
Annual Conference on Manual Control 1969, 
NASASP.215. - 

Taylor, L. A look at pilot modeling techniques at 
low frequencies. I*roeeedings of the 6th Annual 
Conference on Manual Control, 1970, Wriglit- 
Patterson AFB, Ohio. 

Thorsheim, H., Houston, L., & Badger, C. Visual 
and kinesthetic components of pursuit tracking 
performance. Journal of J^latar Beliavior^ 1974, 
6(3), 199-203. 

Verdi, A., Omstein, G., Heydorn, R., & Frost, G. 

Effects of display quickening on human trans- 
fer functions during a dual axis compensatory 
tracking task. AMRL-TR-65-174. Wright- 
Patterson AFB, OH: " Aerospace Medical 
Research Laboratory, 1965, 

Vinje, E., & Miller, D. An analysis of pilot adapta- 
tion in a simulated multiloop VTOL hovering 
task. Proceedings of the 4th Annual NASA- 
University Conference on Manual Control 

1968, NASASP-192. 

Walston, C, & Warren, C. A mathematical analysis 
of the human operator in a closed-loop cvntrol 
system, AFPTRC-TR-54-96. Lackland AFB, 
T>C: Air Force Personnel & Training Rese*freli 
Center, 1954. 



4i 



37 



Ware, J. An input adaptive pursuit tracking model 
of the human operator. Proceedings of the 7th 
Annual Conference on Manual Control, 1971, 
NASASP-281. 

Wamer, J. Manual control system performance, 
with predictive displays. Proceedings of the.4th 
Annual NASA-lln iversity Conference on 
Manual Control, 1968, NASA SP-192. 

Weir, D. Applications of the pilot transition 
response model to flight control system failure 
analysis. Proceedings of the 3rd Annual NASA- 
university Conference on Manual Control, 

1967, NASA SM 44. 

Weir, D., & Johnson, W. Pilot's response to 
stability augmentation system failures and 
implications for design. Proceedings of the 4th 
Annual NASA-University Conference on 
Manual Control, 1968, NASA SP-192. 

Wempe, T., 8l Baty, D. Usefulness of transinfor- 
matibn as a measure of human tracking 
performance. Proceedings of the 2nd Annual 
NASA-University Conference on Manual 
Control 1966, NASA SP-128. 

Wempe, T., 8l Baty, D. Human information 
processing rates during certain multiaxis 
tracking tasks with a concurrent auditory task. 
Proceedings of the 4th Annual NASA- 
University Conference on Manual Control, 

1968, NASA SP-192. 



Whitney, D., & Sheridan, T. State space models of 
remote fhanipulation tasks, hoceedings of the 
4th Annual NASA-University Conference on 
Manual Contrt)h\96%, NASA SP.192. 

Wierwille, W. A theory .for<*optimal deterministic 
characterization of time-varying human opera- 
tor dynamics. IEEE Transactions, oh Human 
Factors in Electronics, 1965, HFE'6(l). 

Wilde, R., & Westcott, ^. The characteristics of the 
human operator engaged in a tracking task. 
Automatica,^ 1962, 1, 5-19. 

Wingrove, R., & Edwards, F. Some examples of 
pilot/vehicle dynamics identified from flight 
test records. Proceedings of the 5th Annual 
Conference on Manual Control, 1969, NASA 
SP-215. 

Young, L. On biocybemetics of the vestibular 
system. Proceedings of the 4th Annual NASA- 
University Conference on Manual Control, 
1968, NASA SP I92. 

Young, L., Forster, J.,& Van Houtte, N. A revised 
sampled data model for eye 'tracking 
movements. Proceedings of the 4th Annual 
NASA-University Conference on Manual 
Control, 1968, NASA SP-192. 



*US GOVERNMENT PRINTING OKFICE: 1978- 771-122/M2 



